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STATISTICAL INFERENCE VERSUS MEAN FIELD LIMIT FOR HAWKES 

PROCESSES 

SYLVAIN DELATTRE AND NICOLAS FOURNIER 


Abstract. We consider a population of N individuals, of which we observe the number of 
actions until time t. For each couple of individuals j may or not influence i, which we 

model by i.i.d. Bernoulli(p)-random variables, for some unknown parameter p E (0,1]. Each 
individual acts autonomously at some unknown rate p > 0 and acts by mimetism at some rate 
proportional to the sum of some function <p of the ages of the actions of the individuals which 
influence him. The function <p is unknown but assumed, roughly, to be decreasing and with fast 
decay. The goal of this paper is to estimate p, which is the main characteristic of the graph of 
interactions , in the asymptotic N —¥ oo, t —>■ oo. The main issue is that the mean field limit 
(as N —> oo) of this model is unidentifiable, in that it only depends on the parameters p and 
pp. Fortunately, this mean field limit is not valid for large times. We distinguish the subcritical 
case, where, roughly, the mean number m* of actions per individual increases linearly and the 
supercritical case, where mt increases exponentially. Although the nuisance parameter ip is non- 
parametric, we are able, in both cases, to estimate p without estimating tp in a nonparametric 
way, with a precision of order N~ 1 / 2 + up to some arbitrarily small loss. We explain, 

using a Gaussian toy model, the reason why this rate of convergence might be (almost) optimal. 


1. Introduction and main results 

1.1. Setting. We consider some unknown parameters p £ (0,1], p > 0 and p : [0,oo) i-A [0,oo). 
For N > 1, we consider an i.i.d. family (n d^))j=i,...,jv of Poisson measures on [0, oo) x 
[0, oo) with intensity measure dtdz, independent of an i.i.d. family 4 = 1 ... n of Bernoulli(p)- 
distributed random variables. We also consider the system of equations, for i = 1,..., TV, 

n oo -1 -N /»t— 

1 { z <xy N }^( ds ^ dz ) where X t N = v + Jj % J o v(t - s)dZ ] s ’ N . 

Here and in the whole paper, f* means Jj Q t , and f means Jj 0 t y The solution ((^ t I,JV )t>o)i=i ) ... l Ar 
is a family of N counting processes (that is, a.s. integer-valued, cadlag and non-decreasing). The 
following well-posedness result is more or less well-known, see e.g. Bremaud-Massoulie [Hj and m 
(we will apply directly the latter reference). 

Proposition 1. Assume that (p is locally integrable and fix N > 1. The system (JT]) has a unique 
cadlag (T t )t>o-adapted solution o)i=i,...,iv such that Y^iLi < 00 f or a M 0, 

where Tt = cr(7r*(A) : A £ B([ 0, t] x [0, 00 )), i = 1,..., N) V cr(9ij : i, j = 1,..., N). 
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Let us provide a brief heuristic description of this process. We have N individuals and Z' t ' N 
stands for the number of actions of the i-th individual until t. We say that j influences i if and 
only if Oij = 1 (with possibly i = j). Each individual i acts, at time t , with rate X l t ' N . In other 
words, each individual has an autonomous rate of action p as well as a subordinate rate of action 
N~ x X^-=i %JoV(* — s)dZf N , which depends on the number of actions of the individuals that 
influence him, with a weight A” 1 and taking into account the age of these actions through <p. If 
for example tp = al [o,at] > then the subordinate rate of action of i is simply a/N times the total 
number of actions, during [t — K,t], of all the individuals that influence him. 

As is well-known, a phase-transition occurs for such a model, see Hawkes-Oakes [18] (or [13] for 
such considerations on large networks): setting A = / 0 °° <p(t)dt , 

• in the subcritical case where A p < 1, we will see that Z]' N increases linearly with time, at 
least on the event where the family (0»j)i,j'=i,...,JV behaves reasonably; 

• in the supercritical case where A p > 1, we will see that Z]’ N increases exponentially fast with 
time, at least on the event where the family (#ij)i,j= behaves reasonably. 

The limit theorems, and thus the statistical inference, completely differ in both cases, so that 
the present paper contains essentially two independent parts. 

We will not study the critical case where A p = 1 because it is a very particular case. However, 
it would be very interesting to understand what happens near the critical case. Our results say 
nothing about this problem. 


1.2. Assumptions. Recalling that A = J 0 °° p(s)ds , we will work under one of the two following 
conditions: either for some q > 1, 


(H(q)) 

or 


p £ (0,oo), Ap £ (0,1) and 


s q p(s)ds < oo 


(A) p £ (0, oo), A p £ (l,oo) and / |d<^(s)| increases at most polynomially. 

Jo 

In many applications, p is smooth and has a fast decay, so that, except in the critical case, either 
H(q) is satisfied for all q > 1 or A is satisfied. 


l. 3. References and fields of application. Hawkes processes have been introduced by Hawkes 
m and Oakes-Hawkes m have found a noticeable representation of such processes in terms of 
Galton-Watson trees. Since then, there has been a huge literature on Hawkes processes, see e.g. 
Daley and Vere-Jones [T2] for an introduction, Massoulie [23], Bremaud-Massoulie [5] and [T3] for 
stability results, Bremaud-Nappo-Torrisi m, Zlru [35, 136] and [3J for limit theorems, etc. Hawkes 
processes are used in various fields of applications: 

• earthquake replicas in seismology, see Helmstetter-Sornette m, Kagan [23, Ogata [25] , Bacry- 
Muzy [5], 

• spike trains for brain activity in neuroscience, see Griin et al. [T5[ . Okatan et al. (27], Pillow 
et al. 23], Reynaud et al. mm, 

• genome analysis, see Reynaud-Schbath 130] . 

• various fields of mathematical finance, see Ait-Sahalia et al. JT], Bauwens-Hautsch [f|, Hewlett 

m, Bacry et al. [2], Bacry-Muzy [U(5], 

• social networks interactions, see Blundell et al. [5] and Zhou et al. [33] , 
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Concerning the statistical inference for Hawkes processes, only the case of fixed finite dimension 
N has been studied, to our knowledge, in the asymptotic t —> oo (for possibly more general shapes 
of interaction). Some parametric and nonparametric estimation procedures for p and ip have been 
proposed, with or without rigorous proofs. Let us mention Ogata [2K] . Bacry-Muzzy [5], [2], the 
various recent results of Hansen et al. [16] and Reynaud et al. BO. TH i ITTiJj . as well as the Bayesian 
study of Rasmussen [29]. 

1.4. Goals and motivation. In many applications, the number of individuals is very large (think 
of neurons, financial agents or of social networks). Then we need some estimators in the asymptotic 
where N and t tend simultaneously to infinity. This problem seems to be completely open. 

We assume that we observe (■Z’s’ Ar )i=i,...,Ar,s£[o,t] (or, for convenience, (■2^’ Ar )i=i 1 ...,./v,s6[o,2t]); that 
is all the actions of the individuals on some (large) time interval. 

In our point of view, we only observe the activity of the individuals, we do not know the graph of 
interactions. A very similar problem was studied in [32j . although in fixed finite dimension N. Our 
goal is to estimate p , which can be seen as the main characteristic of the graph of interactions, since 
it represents the proportion of open edges. We consider p and ip as nuisance parameters, although 
this is debatable. In the supercritical case, we will be able to estimate p without estimating p nor 
ip. In the subcritical case, we will be able to recover p estimating only p and the integral A of ip. 
In any case, we will not need to provide a nonparametric estimation of ip , and we believe it is a 
very good point: it would require regularity assumptions and would complicate a lot the study. 

The main goal of this paper is to provide the basic tools for the statistical estimation of Hawkes 
processes when both the graph size and the observation time increase. Of course, this is only a 
toy model and we have no precise idea of real world applications, although we can think e.g. of 
neurons spiking: they are clearly numerous (so N is large), we can only observe their activities 
(each time they spike), and we would like to have an idea of the graph of interactions. See again 
[32] for a more convincing biological background. Think also of financial agents: they are also 
numerous, we can observe their actions (each time they buy or sell a product), and we would like 
to recover the interaction graph. 

1.5. Mean field limit. We quickly describe the expected chaotic behavior of (( Z q t ' N ) t >o)i=\ } ...,N 
as N —> oo. We refer to Sznitman [33] for an introduction to propagation of chaos. Extending 
the method of m Theorem 8], it is not hard to check, assuming that J 0 °° ip 2 (s)ds < oo, that for 
each given k > 1 and T > 0, the sample ((Zl' N ) tG [ 0 Tl)i=i,...,fc goes in law, as N —i oo, to a family 
(P?) te[o,T])i=i,...,fc of i.i.d. inhomogeneous Poisson processes with intensity (At)t>o, unique locally 
bounded nonnegative solution to At = /i + J^pipit — s)X s ds. 

On the one hand, approximate independence is of course a good point for statistical inference. 
On the other hand, the mean-field limit (i.e. the (Yf) t > o’s) depends on p and ip only through 
(At)t>o and thus through pip , which is a negative point: the mean-field limit is unidentifiable. The 
situation is however not hopeless because roughly, the mean-field limit does not hold true for the 
whole sample (Z l ’ N ) i= y...^ and is less and less true as time becomes larger and larger. 

1.6. Main result in the subcritical case. For N > 1 and for ({Z l t ' N the solution to 

([l]), we introduce Z^ = N~ l XOiLi Zf N . We mention in the following remark, that we will prove 
later, that the number of actions per individual increases linearly in the subcritical case. 
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Remark 2. Assume H( 1). Then for all e > 0, 


lim Pr 

(N,t)—> (00,00) 


Z t N 




t 1 — A p 


> £ = 0 . 


We next introduce 


CiV _ 

C t ~ 


yN yN 


N yi,N ryi,N 

^2 1 p 

c t 


V? = E (— 


i= 1 


t = 2Z? Att - Z» t , where ?L = J E ( 


t 

2 t/A 


N \ 2 _ ^[cN 

4 ) t ’ 


v A,t 


ryN ryN A cN 

A kA ~ A (k- 1)A — ^ c t 


k—t/A +1 

In the last expression, A £ (0, t) is required to be such that t/{ 2A) £ N*. 


)'■ 


Theorem 3. Assume H{q) for some q > 3. For t > 1, put A t = t / (2\t x ~ 4 ‘^ q+1 ' > \): it holds that 
t/(2A t ) £ N* and that A t ~ t 4 A<3+ 1 )/2 as t —► oo. There is a constant C depending only on p, p, 
ip and q such that for all e £ (0,1), all A > 1, all t > 1, 


Pr 

Pr 




cN _ 

4 1 - A V 


, C ( 1 1 

>£ < - T7 + 


E ) 


£ V1V y'Af t q r 

( vjV _ /i 2 A 2 p(l-p) A < + J_\ 

V 4 (1 — Ap) 2 / e\ t y/N' 

1 


Pr ( 


T 


yoN _ 

WAt ' 4 (1 — Ap) 3 


, C / 1 A 

>£ < - N7 + TY 


E ) 


£ \N t 2 Vt 1 -*/(</+!) / 


V 


We will easily deduce the following corollary. 


Corollary 4. Assume H(q) for some q > 3. For t > 1, put A t = t/(2[t x 4 A 9+1 lj). There is a 
constant C depending only on p, p, ip and q such that for all £ £ (0,1), all N > 1, all t > 1, 


Pr 


(II^V-WE) - Oh A, p) || > e) <j(-L + ^T + 


1 


< 


^ t !-4/( q+ l) 

VN n 


~Vn 

2C / 1 

TVyl 1 t i-4/(,+i);> 

where = 1 £><f> with D = {(it, v, w) £ R 3 : w > u > 0 and v > 0} and $ : D K> M 3 defined by 

fu v -\- \u 4 > i(u, v, if)] 2 1 1 4 > i(n,u,ir) 

& 1 (u,v,w)=uJ-, $ 2 (u,«,ttf) = -^^-E, & 3 (u,v,w )= - — -^ 

V W U[U — V, U>)J <P 2 (u,v,w) 

We did not optimize the dependence in q: in many applications, F[(q) holds for all q > 1. 


1.7. Main result in the supercritical case. For N > 1 and for {(Z l t ' N ) t > o)i=i,...,iv the solution 
to ([l]), we set Z^ = A -1 Y^iLi %l' N ■ We will check later the following remark, which states that 
the mean number of actions per individual increases exponentially in the supercritical case. 

Remark 5. Assume A and consider ao > 0 uniquely defined by p / 0 °° e~°‘° t ip{t)dt = 1. Then 

for all rj > 0, lim lim Pr (Zf £ [e^ 0- ^ 4 , = 1. 

t—>oo N—>oo V / 




























STATISTICAL INFERENCE VERSUS MEAN FIELD LIMIT FOR HAWKES PROCESSES 


5 


We next introduce 


N 


U, N = 


[£( 

i— 1 


,N 


~Z t N ' 


z t N 


A 

w 


W> 0} 


and Vr = 




W> o}- 


Theorem 6. Assume A and consider ao > 0 defined in Remark [3| For all r) > 0, there is a 
constant C v > 0 (depending only on p , p, ip, p) such that for all A > 1, all t > 1, all e £ (0,1), 


Pr (\V t N 



C„e* rVN 

e \e aot 



1.8. Detecting subcriticality and supercriticality. In practise, we may of course not know if 
we are in the subcritical or supercritical case. 


Proposition 7. (i) Under H(l), there are some constants 0 < c < C depending only onp,p,p 
such that for all A > 1. all t > 1, Pr(log(Z t Ar ) > (logt) 2 ) < C(e~ cN + t 1 / 2 e _ ( logt ^ ). 


(ii) Under A, for all p > 0, there is a constant C v depending only on p 1 p, ip, p such that for all 
A > 1, all t > 1, Pr(log (Z?) < (logt) 2 ) < C^e^A" 1 / 2 + e~ aot ). 

It is then not hard to check that, with the notation of Corollary [4] and Theorem |6j under H(q) 
(for some q > 3) or A, the estimator 

Pt = 1 {log(Zf)<(logt) 2 }^'3(^2Tt J /2> W A t/2 ,t/2) + 1 {log(Zf)>(logt) 2 }A JV > 

which is based on the observation of (Z] ,Ar ) sg ro,tu=i,...,jv, converges in probability to p, with the 
same speed of convergence as in Corollary [4] (under H(q) for some q > 3) or as in Theorem [6] 
(under A). 

1.9. About optimality. In Subection |2.3[ we will see on a toy model that there is no real hope to 
find an estimator of p with a better precision than A -1 / 2 + iV 1 / 2 ?™)” 1 , where mt is something like 
the mean number of jumps per individual during [0, t]. Consequently, we believe that the precision 
we found in Corollary [4] is almost optimal, since then m t — t by Remark [2] and since we reach the 
precision A -1 / 2 + A 1 / 2 ^ -1 for any a > 0 (if p has a fast decay), so that the loss is arbitrarily 
small. Similarly, the precision found in Theorem [b] is rather satisfying, since then m ( ~ e aot by 
Remark|H]and since we reach the precision e I)t (A -1 / 2 + A 1 / 2 e _ “° t ) for any 77 > 0, so that the loss 
is, here also, arbitrarily small. 

The main default of the present paper is that the constants in Corollary [4] and in Theorem 
[6] strongly depend on the parameters /r,A,p. They also depend on q in the subcritical case. In 
particular, it would be quite delicate to understand how they behave when approaching, from 
below or from above, the critical case. 


1.10. About the modeling. There are two main limitations in our setting. 

Assuming that the difi s are i.i.d. is of course a strong assumption. What we really need is that 
the family i,...,jv satisfies similar properties as those shown in Subsection 4.1 (in the sub¬ 

critical case) and in Subsection 5.1 (in the supercritical case). This clearly requires that the family 
b-.-A is not too far from being i.i.d., and it does not suffice that lirn/v^oo A -2 1 ®ij = 

p. However, we believe that all the conclusions of the present paper are still true if one assumes 
that is i.i.d. and that Oji = Oij for all 1 < i < j < A, which might be the case 

in some applications where the interactions are symmetric. A rigorous proof would require some 
work but should not be too hard. We will study this problem numerically at the end of the paper. 
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Assuming that we observe all the population is also rather stringent. It would be interesting to 

study what happens if one observes only {Z l s ' N ) i= i > _jc,ae[o,i] j f° r some K large but smaller than 

N. It is not difficult to guess how to adapt the estimators to such a situation (see Section [7] for 
precise formulae). The theoretical analysis would require a careful and tedious study. Again, we 
will discuss this numerically. 

1.11. Notation. We denote by Prg the conditional probability knowing We intro¬ 

duce Eg, Varg and Covg accordingly. 

For two functions f,g : [0, oo) ha ]R, we introduce (if it exists) (/ * g){t) = J^f(t — s)g(s)ds. 
The functions p* n will play an important role in the paper. Observe that, since / 0 °° ip(s)ds = A, 
/o°° l P* n {s)ds = A". We adopt the conventions ip*°(s)ds = S 0 (ds) and — s)ds = S t {ds). We 

also adopt the convention that ip* n (s) = 0 for s < 0 . 

All the finite constants used in the upperbounds are denoted by C, the positive constants used 
in the lowerbounds are denoted by c and their values change from line to line. They are allowed to 
depend only on p , p and ip (and on q under H(q)), but never on N nor on t. Any other dependence 
will be indicated in subscript. For example, C v is a finite constant depending only on /i, p , ip and 
77 (and on q under H(q)). 

1.12. Plan of the paper. In the next section, we try to give the main reasons why our estimators 
should be convergent, which should help the reader to understand the strategies of the proofs. We 
also briefly and formally introduce a Gaussian toy model in Section |2.3| to show that the rates 
of convergence we obtain are not far from being the best we can hope for. In Section [3j we 
prove Proposition [I] (strong existence and uniqueness of the process) and check a few more or less 
explicit formulae concerning (^(’ JV )i=i,...,Ar,t>o of constant use. Section [ 4 ] is devoted to the proof 
of Theorem [ 3 ] and Corollary [4] (main results in the subcritical case). Theorem [6] (main result in 
the supercritical case) is proved in Section [ 5 J We check Proposition [7] in Section [b] Finally, we 
illustrate numerically the results of the paper and some possible extensions in the last section. 

2. Heuristics 

This section is completely informal and the symbol ~ means nothing precise. For example, 
“ Z\' N ~ Eg[Z\' N ] for t large” should be understood as “we hope that Z\ ,N /Eg[Z\ ,N ] tends to 1 as 
t 00 in probability or in another sense.” 

2.1. The subcritical case. We assume that A p £ [0,1) and try to explain the asymptotics of 

(Zp ) i=1 . N,t>o an d where the three estimators , V t N and W£ t come from. We introduce the 

matrices A N (i,j) = N~ 1 9 i j and Qn = (I — AA^) -1 , which exists with high probability because 
A p < 1. We also set i N (i) = Qiv(b j) and c N (i) = YljLi QnU,i)- 

Fixing N and knowing (^»j)*,j=i .iv, we expect that Z l t ’ N ~ Eg[Z l t ,N ) for t large by a law of large 

numbers. Next, it is not hard to check that Eg[Zl’ N ] = pt + N _1 J^jLi %JoV(7 — s)Eg[^ ,Ar ](is. 
Assume now that 7at(«) = lim^oo t~ l Eg[Z\' ] exists for each i = 1 Then, using that 

f Q <p(t — s)sds ~ At for t large, we find that the vector 7 ^ must solve 7 jv = gl n + A 
where In is the iV-dimensional vector with all coordinates equal to 1. This implies that 7 n = 
/r(J — AAn) _1 1n = p(-N- We thus expect that Z l t ,N ~ Eg [Z\ ,N ] ~ p(. N (i)t. 

Based on this and setting t N = N~ x ^at(*)i we expect that 2™ ~ gl N t for large values of 
t, whence := t~ l Z^ ~ 
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Knowing should resemble, roughly, a Poisson process, so that it should ap¬ 

proximately hold true that Varg (Z]' N ) ~ E g[Zl' N ]. Thus iV _1 J2iLi(Zt’ N — Z^) 2 should resemble 
¥ar ( Z]' N ) = Var ( Eg[Zl ' N ]) + E[¥ar@ ( Z }' N )] ~ ¥ar (E g[Zl’ N ]) + E [Zj' N ], which itself resembles 
N_1 Y^iLi(. K e[Zt N ] - E e[Z*]) 2 + Z f ~ N^pH 2 Eili(^v(*) “ ^n) 2 + Z// Consequently, we 
expect that V t N := t~ 2 [Y^f =1 (Zl’ N - Z?) 2 - NZ^] ~ p 2 Eili(^v(*) - /a) 2 for t large. 

Finally, the temporal empirical variance At -1 J2k =1 l^kA ~ ^(fc-i)A — A t~ 1 Z^ r ] 2 should resemble 
¥ar e [Z%] if 1 « A « t. Thus W» t := AT" 1 E^V^a-A*" 1 ^] 2 =* ^"^ar* [Z£]. 
Introducing the martingales = Z/' V — C t l,JV (where d7* ,JV is the compensator of Z l,N ), the 

centered processes U%’ N = Z‘ t ' N — E g[Z\' N ], and the iV-dimensional vectors U/ and M/ with 
coordinates Ul' N and M l t ' N , we will see in Section [ 3 ] that U/ = M/ + A N fg<p(t — s)U/ds, so 
that for large times, U/ ~ M/ + AAatU/ and thus U/ ~ QjvMf. Consequently, we hope that 
U t N ~ Q n M?, where U t N = A" 1 u l' N and Qn^W = A" 1 Eti(QivMf /. A little study 
shows that the martingales M(' N are orthogonal and that [M- 7,JV ; M^' N ] t = Z{’ N ~ p(-N{j)t , so 
that ¥ar e (QatM/) ~ ptlV -2 Ejti(EiIi QN{i,j)) 2 f-N(j) = ptN~ 2 Ejii( c A(j)) 2 Mj)- Finally, 
¥arg [Z^] = ¥arg [j/^] ~ ptN~ 2 Ej1i( c a(j)) 2 ^a(j) and we hope that W^ t ~ 1VA -I ¥ar0 [Zj^] ~ 
pAt -1 ZU(cN(j)) 2 t N (j) if 1 < A < t. 

We thus need to find the limits of In, E^Li(^v(*) ~ I- a) 2 and TV -1 Euli^ a(*)(ca(*)) 2 as 
N ^ co. It is not easy to make rigorous, but it holds true that ^v(*) - 1 + A(1 - Ap) 1 L N (i), 
where L N (i) = A N (i,j). This comes from A 2 N (i,j) = Yfj=i A N{i,j) EfcU A N (j, k) ~ 
P^ljLi An( 1, j) = pLn(i), EjLi A%(i,j) ~ p 2 L]y(i) for similar reasons, etc. It is very rough, 
but it will imply that t N {i) = E„>o A " EyLi A n(I l) - 1 + En>i A n p n ~ 1 L N (i) = 1 + A(1 - 
Ap)~ 1 LN{i). Once this is seen (as well as a similar fact for the columns), we get convinced, NLn 
being a vector of N i.i.d. Binomial(./V,p)-distributed random variables, that In — 1/(1 — Ap), that 
E£i(M*) - t N ) 2 ~ A 2 p(l -p)/(l - Ap) 2 and that N~ 2 E 1 I 1 ^v(*)(ca(*)) 2 ^ 1/(1 - Ap) 3 . 

At the end, it should be more or less true that, for t, A and N large enough and in a suitable 
regime, £^ ~ p/(l — Ap), ~ p 2 A 2 p(l —p)/(l — Ap) 2 , and VV^ t ~ p/(l — Ap) 3 . Of course, all 
this is completely informal and many points have to be clarified. 

Observe that concerning V t v , we use that Zj’ N resembles a Poisson process, while concerning 
W% t , we use that Z t N does not resemble a Poisson process. 

The three estimators , V) v , W/ f we study in the paper resemble much £^ T , V( v , VV/ r and 
should converge to the same limits. Let us explain why we have modified the expressions. We 
started this subsection by the observation that E g[Z\' N ] ~ p/v(?')f, on which the construction of 
the estimators relies. A detailed study shows that, under H(q), E g[Z l t N ] = ptN(i)t + xf A f 1_? , 
for some finite random variable xf ■ As a conseciuence, t-^-EglZ^ — Z)' N ] converges to p£jv(«) 
considerably faster (with an error in t~ q ) than f -1 E@[Z/ ] (for which the error is of order f -1 ). 
This explains our modifications and why these modifications are crucial. 

Let us conclude this subsection with a technical issue. If A > 1 (which is not forbidden even 
in the subcritical case), there is a positive probability that an anomalously high proportion of the 
dij's equal 1, so that I — A An is not invertible and our multivariate Hawkes process is supercritical 
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(on this event with small probability). We will thus work on an event on which such problems 
do not occur and show that this event has a high probability. 

2.2. The supercritical case. We now assume that A p > 1 and explain the asymptotics of 
{Z l t ' N )i = i...^N,t>o and where the estimator comes from. We introduce Ax{i,j) = N~ 1 9 i j. 

Fixing N and knowing (0jj)i,j=i,...,iV) we expect that Z/ N ~ Hn^-o\Z\’ N \ , for some random 
H n > 0 not depending on i (and with H N almost constant for N large). This is typically a 
supercritical phenomenon, that can already be observed on Galton-Watson processes. Fortunately, 
we will not really need to check it nor to study Hn, essentially because we will use the ratios 
Z' t ’ N /Z t N , which makes disappear Hn- 

Next, we believe that E g[Z\' N ] ~ 7 iv(?’) eQJvt for t large, for some vector with positive entries 
and some exponent aN > 0. Inserting this into E g[Z l t ' N ] = /. d + N~ x 0ijfo<p(t — s)Eg[Z J s ’ N ]ds, 
we find that 7 at = An"/n f 0 e~ aNS ip(s)ds. The vector 7 n being positive, it is necessarily a Perron- 
Frobenius eigenvector of An, so that pn = (/ 0 °° e~ aNS <p(s)ds )~ 1 is its Perron-Frobenius eigenvalue 
(i.e. its spectral radius). We now consider the normalized Perron-Frobenius eigenvector Vn such 
that ££i(Viv(i )) 2 = N and conclude that Z l t ' N ~ K N VN(i)e aNt for all i = 1 where 

K N = [N-^l 1 hN(i)) 2 ] 1/2 H N . 

Exactly as in the subcritical case, the empirical variance IV -1 ’Yhi—x{.Z\’ N — Z^) 2 should resemble 
N- 1 - MZ t N }) 2 + Z? ~ N~ 1 Kj f e 2otNt ZZi(W) - Vn ) 2 + Z t N . Since we also 

guess that Z/ 1 ~ K N VNe aNt , where Vn = IV -1 Y/Zi V)v(*), we expect that for t large, U/ 1 = 

{zn~ 2 \E?=iW N - zn 2 - Nzn ~ ( v N r 2 £f = 1 cM*) - v N ?. 

We now search for the limit of ( Vn )~ 2 YlZi (Viv(*) — Vn) 2 as N —> 00 . Roughly, A^(i, j) ~ 
p 2 /N, whence, starting from A 2 n Vn = P%Vn, we see that p 2 n Vn — p 2 Vn1n, where 1^ is the N- 
dimensional vector with all coordinates equal to 1. Consequently, Vn = (AnVn)/Pn — knAnIn, 
where kn = (p 2 / P%)Vn- In other words, Vn is almost colinear to Ln := AnIn, and NLn is 
a vector of N i.i.d. Binomial(./V,p)-distributed random variables. It is thus reasonable to expect 
that (Vn)~ 2 EZi(V N ( i) ~ Vv) 2 * (L N )~ 2 EZi(Ln(i) - L N ) 2 * p~ 2 p( 1 - p) = 1/p - 1. 

All in all, we hope that for N and t large and in a suitable regime, U/ 1 ~ 1/p — 1. 

Finally, let us mention that aN — oq (see Remark [ 5 ]) because / 0 °° e~ aNS y(s)ds = 1/pN, be¬ 
cause / 0 °° e~ aoS ip(s)ds = 1/p and because pn — p ■ This last assertion follows from the fact that 
A 2 N (i,j) ~ p 2 /N, so that the largest eigenvalue of A 2 N should resemble p 2 , whence that of A N 
should resemble p. 

Of course, all this is not clear and has to be made rigorous. Let us mention that we will use a 
quantified version of the Perron-Frobenius of G. Birkhoff [7]. As we will see, the projection onto 
the eigenvector Vn will be very fast (almost immediate for N very large). 

As in the subcritical case, we will have to work on an event £1%, of high probability, on which 
the Oij’s behave reasonably. For example, to apply the Perron-Frobenius theorem, we have to be 
sure that the matrix An is irreducible, which is not a.s. true. 

2.3. About optimality: a related toy model. Consider ao > 0 and two unknown parameters 
T > 0 and p £ (0,1]. For N > 1, consider an i.i.d. family (0ij)»,j=i,...,JV of Bernoulli (p)-distributed 
random variables, put X/ N = A/’ _1 Fe a ° t £ . =1 6ij and, conditionally on (0ij)i t j = consider 


STATISTICAL INFERENCE VERSUS MEAN FIELD LIMIT FOR HAWKES PROCESSES 


9 


a family (Zj'' N ) t >Q ,..., (Z^' N ) t > 0 of independent inhomogeneous Poisson processes with intensi¬ 
ties (\l’ N ) t >o, ■ ■ ■, (X^' N )t>o- We observe (Zl’ N ) se i o,t],*=i,...,JV an d we want to estimate p in the 
asymptotic (N,t) —> ( 00 , 00 ). 

This problem can be seen as a strongly simplified version of the one studied in the present paper, 
with a 0 = 0 in the subcritical case and ao > 0 in the supercritical case. Roughly, the mean number 
of jumps per individual resembles mt = J Q e a ° s ds, which is of order t when ao = 0 and e aot else. 

There is classically no loss of information, since ao is known, if we only observe (Zf N )i— i,...,jv: 
after a (deterministic and known) change of time, the processes (Zf N ) j=i iv become homogeneous 
Poisson processes with unkown parameters (conditionally on (&y)ij=i,...,Ar), and the conditional 
law of a Poisson process on [0, t] knowing its value at time t does not depend on its parameter. 

We next proceed to a Gaussian approximation: we have Xl’ N ~ Te aot [p + ^/iV _1 p(l — p)]Gi 
and Zf N ~ S>s N ds + JW^sH., for two independent i.i.d. families (fii)i=i,...,Ar 

of Af(0, l)-distributed random variables. Using finally that (mt)^ 1 -/V -1 / 2 <C (mi)” 1 in our as¬ 
ymptotic, we conclude that ( m t )~ 1 Zf N ~ Tp + Tyj N~ 1 p(l — p)Gi + \J (m t ) W pH which is 
Af(Tp,N~ 1 V 2 p(l — p) + (m t ) _1 Tp)-distributed. 

Our toy problem is thus the following: estimate p when observing a ./V-sample (A’/ ,JV ) i=lj . jv 
of the Af(Tp, iV- 1 r 2 p(l — p) + (m t ) _1 rp)-distribution. We assume that Tp is known, which can 
only make easier the estimation of p. As is well-known the statistic S^ = IV -1 ~ Tp) 2 

is then sufficient and is the best estimator (in all the usual senses), for N > 1 and t > 1 fixed, 
of N~ 1 T 2 p(l — p) + (m t ) _1 Tp, so that = N(Tp)~ 2 (S^ — mf^Tp) is more or less the best 
estimator of (1/p — 1). But Yar Sf 1 = 2N~ 1 (N~ 1 T 2 p(l — p) + (m t ) _1 Pp) 2 , whence Var = 
2(rp)- 4 (Y" 1 / 2 r 2 p(l — p) + A rl / 2 (m t ) _1 rp) 2 . It is thus not possible to estimate (1/p — 1) with a 
better precision than IV -1 / 2 + TV 1 / 2 (rot) -1 . This of course implies that we cannot estimate p with 
a better precision than IV -1 / 2 + A rl ' /2 (m t ) _1 . 

3. WELL-POSEDNESS AND EXPLICIT FORMULAE 

We first give the 

Proof of Proposition^ 7} Conditionally on (0jj)i,j=i,...,iV) we can apply directly [TTSj. Theorem 6], of 
which the assumption is satisfied here, see m Remark 5-(i)]: conditionally on (#i.j)*,j=i,-..,iv> there 

is a unique solution (Z\’ N )t> o,»=i. n to ([l]) such that YliLi E 0 [^t’ N \ < 00 f° r a ll t > 0. Since 

now (^ij)jj=i....,iv can only take a finite number of values, we immediately deduce that indeed 

Yf*Li E fe’ w ] < 00 for a11 * > 0- □ 

We carry on with a classical lemma. Recall that <p*°(t — s)ds = 5 t (ds) by convention. 

Lemma 8. Consider d > 1, A £ AT^x^R), '■ [0, 00 ) ha R" 1 locally bounded and assume 

that ip : [0, 00 ) ha [0, 00 ) is locally integrable. If mt = gt + /q<p(£ — s)Am s ds for all t > 0, then 
™t = En>o JoV n (t - s)A n g s ds. 

Proof. The equation m t = g t + fg<p(t— s)Am s ds with unkown m has at most one locally bounded 
solution. Indeed, consider two such solutions ro,ro, observe that u = \m — ro| satisfies u t < 
\A\f Q ip(t — s)u s ds, and conclude that u = 0 by the generalized Gronwall lemma, see e.g. [Till 
Lemma 23-(i)]. We thus just have to prove that m t := En>o J*p* n (t-s)A n g s ds is locally bounded 
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and solves m = g + Aip-km. We introduce fc" = \A\ n f*tp* n (s)ds, which is locally bounded because 
<p is locally integrable and which satisfies fc" +1 < \A\f*k™ip(t — s)ds. We use ms Lemma 23-(ii)] to 
conclude that E n >o locally bounded. Consequently, \m t \ < sup[ 0>t j |g s | x E n >o^t is locally 
bounded. Finally, we write m = g + E n >i A n <p* n *g = g + A n ip* n *g = g + Aip*m as 

desired. □ 


We next introduce a few processes. 


Notation 9. Assume only that ip is locally integrable, fix N > 1 and consider the solution 
(Zl' N ) t >o,i=i,...,N to ([l]). For each i = 1 we introduce the martingale (recall that \ Z,N 

was defined in 


Mf N = 


o Jo 


L U<W JV } 


mi 7P(ds, dz), 


where Tt l (ds,dz) = Tr l (ds, dz) — dsdz is the compensated Poisson measure associated to n 1 . We also 
introduce = sup[ 0 t ] \M l s ' N \, as well as the (conditionally) centered process 


For each t > 0, we denote by Zfi (resp. 


u\' N = z t 

N 


l ’ N - E e [Z l t ’ N i 


coordinates Z\’ N (resp. M t 


i,N 


M, 


i,N ,* 


M?, M t 


t 

AT,* 


ufi N ). 


, the N-dimensional vector with 

We also set Z t N = N _1 Eh Z\' N , M t N = 


N- 1 Eh and U t N = N~' Eh Ufi N . 

We refer to Jacod-Sliiryaev [22, Chapter 1, Section 4e] for definitions and properties of pure 
jump martingales and of their quadratic variations. 

Remark 10. Since the Poisson measures tt 1 are independent, the martingales AP’ N are orthogonal. 
More precisely, we have [M t,N = 0 ifi^j, while [M l ’ N , = Zf N (because Z\' N 

counts the jumps of M Z ’ N , which are all of size 1). Consequently, E e\M l s ' N Mfi N ] = \u—j\¥jg[Z l s '^ t ]. 

We now give some more or less explicit formulas. We denote by ljy the iV-dimensional vector 
with all entries equal to 1 and we set Ajsr(i,j) = N~ 1 9ij for i,j = 1,..., N. 

Lemma 11. Assume only that <p is locally integrable. We have (recall that ip*°(t— s)ds = d t {ds)): 


( 2 ) 

(3) 

(4) 


N 


Zf =M ( 


+ gl N t+ f tp(t - s)A N Z^ ds, 

Jo 


E e [Zf] =p \ [ sip* n (t - s)ds 

71 >0 LJ ° 

u f=E [\* n (t~s)A n N M^ds. 

n> CT 0 

Proof. The first expression is not difficult: starting from ([l]), 


n l n, 


Z\' N = Mf N 


+ I A \’ N ds = Mf 1 ' + 


i.N 


N pt ps 

lit + A N (j, j) I / <p(s - u)dZi' N ds. 

j=1 Jo Jo 


Using m Lemma 22], we see that /„* /„ s (p(s — u)dZf’ N ds = jh(t — s)Zfi N ds, whence indeed, 
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which is nothing but ([2]). Taking conditional expectations in ([2]) , we find that EgfZ^] = jil^t + 
Jq<P( t — s)AjvEe[Z^ r ]ds and thus also + fg<p(t — s)AjvTJ^ds. Since now ip is (a.s.) 

locally integrable, since pljvt and M( v are (a.s.) locally bounded, as well as EgfZ^] and U^, (|3| 
and Q directly follow from Lemma [8j □ 

4. The subcritical case 


Here we consider the subcritical case. We first study the large iV-asymptotic of the matrix 
Qn = (/ — A An)- 1 , which plays a central role in the rest of the section. In Subsection 4.2 we 
finely study the behavior of p* n . In Subsection |4.3[ we handle a few computations to be used 
several times later. Subsections |4.4l |4.5| and |4.6| are devoted to the studies of the three estimators 
£ 


N 


V t N and Wgt ■ We conclude the proofs of Theorem [ 3 ] and Corollary |ij in Subsection 


4.7 


4.1. Study of a random matrix. We use the following standard notation: for x = (xi ,..., Xn ) £ 
and r £ [l,oo), we set ||a:|| r = \ x i\ r Y^ r and Halloo = max != i 

we denote by 111 ■ 


the operator norm on Mnxn{^) associated to 


,n \xi\- For r £ [1, 
r . We recall that 


00 


N 

: sup VlMyl, |||M||| 00 = sup 
7=1 


N 

E 

i=i 


I Mi. 


and that for all r £ 

(5) 


(l,oo) 


1/r 

1 


1 —1/r 


Notation 12. We assume that A p < 1. For each N > 1, we introduce the N x N random matrix 
An defined by AN{i,j) = N~ l 6ij, as well as the event 

(6) Qn = |A|||Ajv|||r < a for all r £ [1, 00 ] j, where a = + ^ £ (Ap, 1). 

On Hjy, the N x N matrix Qn = Y2n>o AnA N = {I — AAtv) -1 is well-defined and we in¬ 
troduce, for each i = 1 In{I) = TYj=iQN{fj), cn{I) = QnUA), os well as 

In = J2iLi In{I) and cn = -/V -1 YliLi c N[i)- We of course have In = Cn- 
Let us remark once for all that, with C= 1/(1 — a) < 00 , 

(7) Qn C {HIQvlllr < C for all r £ [1, 00 ]) C { sup max{f/v(*), c N (i)} < c), 

(8) 0,^ C |l{i=j} < Qiv(b j) < l{t=j} + ACW _1 for all i, j = 1,..., Tvj. 

Indeed, ([7]) is straightforward since Qn = J2 n >o A"A^. To check Q, we first observe that 
QN{i,j) > A °A° N {i,j) = 1 {i=j}. Next, we use that Ajv(i, j) < N~ l while, for n > 2, A^ii, j) = 
T.ti A N{i,k)A n N -\k,j) < < ^- 1 |||A-- 1 |||i < ^lll^ivllir 1 . Thus 

A n(^3) — N 1 |ll^v||li 1 for all n > 1. Hence on Q^, it holds that Qn(U) < + 

■N -1 En>i A-IIIA^Hir 1 < + N~ 1 A /(1 - a) as desired. 

Lemma 13. Assume that A p < 1 .It holds that Pr(H] v ) > 1 — C exp (—cN). 

Proof. By ([ 5 ]), it suffices to prove that Pr(A|||Ajv|||i > a) < Cexp(-cN) and Pr(A|||Ajv||| 0O > 
a) < Cexp(-cN). Since IHAjvIHoo = |||A)v|||i an d since A* N (the transpose of An) has the same 
law as An, it actually suffices to verify the first inequality. First, A7| 11111 i = maxjX^,..., 
where Af = ]T J=1 % i s Binomial(N,p)-distributed for each i. Consequently, Pr(A|||A/v|||i > a) < 
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TVPr(Xf^ > Na/A) < TVPr(|A ^ — Np\ > N(a /A — p)). Since a /A > p , we can use the Hoeffding 
inequality [2T| to obtain Pr(A|||Ajv|||i > a) < 2TV exp(— 2N(a/A — p) 2 ) < Cexp(— N(a/A — p) 2 ) 
as desired. □ 


The next result is much harder but crucial. 


Proposition 14. Assume that Ap < 1 .It holds that 

1 2 


E 


£n - 


< 


C 


E 


1 — Ap 

lgM0(CAT(i)) 2 - (1 _ ^3 


TV 2 ’ 

1 2l 


< 


c_ 

TV 2 ’ 


E 


-i i \2 A 2 p( l-p) I C 


Proof. Recall that In is the TV-dimensional vector of which all the coordinates equal 1. Let £n 
(resp. c/v) be the vector with coordinates ^v(l), ■ • •, £n{N) (resp. cjv(1), ■ ■ ■, cn(TV)). We also 
introduce, for all i = 1,..., TV, Ln{i) = Ef=i A N (i ,j) and C N (i) = J2j=i A N(j,i), as well as 
the corresponding vectors Ln and Cn- Let us observe that, with obvious notation, £n = Cn and 
Ln = Cn ■ Finally, we introduce the vectors 

xn = £n — fjvliV) Un = cn — cjvIn, Xn = Ln — LnIn, Yn = Cn — Cn^n- 


We recall that a = (1 + Ap)/2 £ (0,1) and we introduce b = (2 + Ap)/3 £ (a, 1). 

T. We introduce the event 

An = |||Ljv — _pliv11 2 + \\C N — pljvlb < TV 1 / 4 ! c |||Xjv ||2 + IIEvlh < TV 4 / 4 |. 

The inclusion comes from the fact that a.s., ||Xjv ||2 = \\Ln — Ln1at||2 < ||Ljv — xljvlh for 
any x £ R. Since NLn = (Z^ ,..., Z$) with ZA i.i.d. and Binomial(TV,p)-distributed, it is 
very classical that for any a > 0, E[||Ljv — pljvll^] < C a (uniformly in TV), we have similarly 
E[||Cjv -plwllf] < c a , so that 

Pr(^iv) > 1 - C a N~ a /\ 

Step 2. We now check the following points: (i) E[|Zjv — p| 2 ] < CTV -2 , (ii) E[||J*Cjv1 12 ] < C, (iii) 
E[(I|AW||| -p(l-p)) 2 ] < CN- 1 and (iv) E[||111] < CTV -1 . 

Point (i) is clear, because Ln = TV -2 Efj=i * s nothing but the empirical mean of TV 2 
independent Bernoulli(p)-random variables. Points (ii) and (iii) are very classical, since TV| |1 12 
is the empirical variance of TV independent Binomial(TV,p)-random variables. We now prove (iv): 


N 


N 


E[PnXn||^] = E e [(E IfOMi) - Ln)) 

i =1 j = 1 3 =1 

by symmetry. We now write EfH-AjvA'jvlH] < 4TV _1 (/jv + Jn + Kn), where 


> 2 1 1 ^ 
= —E 
N 


N 

(y^ijl^C?) - L n )) 


2-i 


N 

/n = e[(Ln-p) 2 (^0i,)‘ 


Jn — E 


(0n(L N (l)-p)) 


K n = IE 


N 

(^2 e ij( LN ti)-p)) 


2-i 
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First, I N < N 2 E[(L n — p) 2 ] < C by (i). Next, it is obvious that J N < 1 (because 6\\ S {0,1} 
and Ln( 1) € [0,1]). Finally, the random variables 0ij(Liv(j) — p) being i.i.d. and centered (for 
j = 2,, TV), we may write 


A' Ar = (TV-l)E[(d 12 (L 7V (2)-p)) 2 ] < (N~1)e[(L n (2)- P ) 


< C. 


since NLn{ 2) follows a Binomial(iV, ^-distribution. This completes the step. 


Step 3. We next prove that (i) xn = AAnXn — Atn^n + AZnXn on £1]^, where tn = 
N~ 2 X^ = i(0*j -p)xnU) and that (ii) |rjy| < A r_3/4 ||a;jv ||2 on n.4iv. 

We start from i N = Qn^-n = (/ — AAjv) _1 ljv, whence £n = In + A A N £ N . Since In = 
X~ 1 (£n, In), we see that In = 1 + AN~ 1 (A n £n, 1a) (here (•,•) is the usual scalar product on 
R^) and thus 

xn =AA n £n - AN~ 1 (A n £n, liv)liv 

=AA n xn - AN~ 1 (A n xn, 1a)1iv + InAA n 1n - InAN~ 1 (A n 1n, 


It only remains to check that N 1 (AnXnAn) = tn , which follows from N 1 (AnXn, Iat) = 
N~ 2 9ij x N{j) and the fact that x nU) = 0; and that A n 1n — At~ 1 (A N lN, 1jv)1jv = 

Xn, which is clear since AnIn = Ln- 

To verify (ii), we observe that r/v = -/V -1 — p) x nU), whence, by the Cauchy- 

Schwarz inequality, |rjv| < AT -1 1 |£Cat11 2 11C'av — plivlb < 3 / 4 ||aiiv|| 2 on Q^HAn. 

Step 4- Let No be the smallest integer such that a + AN 0 1 ^ 4 < b. We check that for all N > No, 

In^n a n ||*iv|| 2<C , ||X jv || 2 . 

Using Step 3 and that ||1jv|| 2 = TV 1 / 2 , we write ||arjv|| 2 < A| 11Ajv|1 12 1|aTiv1 12 + ATV _1 / 4 | |a:jv|b + 
A|£/v|||Abv|| 2 . But on fijy, A|||Ajv||| 2 < a and \In\ < C, see ^ and ([?]). Hence, for N > N 0 , on 
Qn n An, we have ||ccjv11 2 < (a + AiV — 1 / 4 )||£Cjv1 12 + O']|-Xjv || 2 < 6 |]xjv |]2 + C||Xjv|| 2 - Since b < 1 , 
the conclusion follows. 


Step 5. We now prove that for TV > TV 0 , 


E 


L nLn.A N 


In - 


1 


1 — Ap 


2i C 
~ N 2 ' 


Using Step 3, we know that on £1^ n An, In = In + A An£n, whence 

A N A N 

I N = 1 + — ^ A N (i,j)£ N (j) — 1 + wt ^ C N r(j)£N(j) = 1 + A pI N + S N , 


i,j =1 


1=1 


where Sn = AN 1 ^p=i(CAf(j) — p)£n{]). Consequently, In = (1 — A p) 4 (1 + Sn), and we 
only have to prove that E[l n i ciAn^n] — CN~ 2 . To this end, we write Sn = AN~ 1 (aN + 6jv), 
where a N = ~ p) x n{j) and b N = In Yjj= i(CW(j) ~ p)- First, since \I N \ < C on 

£l n by Q, we can write < UE[(J}^ =1 (C , Ar(j) — p)) 2 } = CTV 2 E[(Cjv — p) 2 ] < C, the last 

inequality coming from Step 2-(i) since Cn = Ln- Next, we use the Cauchy-Schwarz inequality: 
a 2 N < \\C N - pljvl| 2 ||a:jv|I 2 < C\\C N — pljv||a|I-X' jv]I 2 on (~1 An by Step 4. Consequently, 
E[l^ n ^<] < C'E[||^ 7V ||1] 1 / 2 E[||C'2 v ^ p1at||1] 1/2 - But E[||^|| 2 ] < C by Step 2-(ii) and we 
have seen at the end of Step 1 that E[||Cjv — pi at 111] < C. 
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Step 6. Here we verify that, still for N > N 0 , 


N 


E 


L ohnAjv 




i= 1 


(1 — A p) 3 


2i C 
~ N 2 ' 


We write, using that c/v = £n, 


^7 v{i)( c N{i)) 2 


= £jv(*)(c/v(*) — C/v) 2 + (£jv) 3 + 

v i=l 


2 

N 


N 

&N ^ £iv(*)( c iv(*) — Cjv). 
i=l 


First, since |Uv| < C on Ujy, we have |(^at) 3 — (1 — A p) 3 | < C\£n — (1 — A p) 1 |, whence 
E [ 1 aj v nA JV K^Jv) 3 -(l-Ap) _3 | 2 ] < CN~ 2 by Step 5. It thus suffices to verify that E[l n j va4jv ((a' Ar ) 2 + 

O'at) 2 )] < c i where a' N = J2iLi £n(*)(cn(*) - c N ) 2 and 6^ = Eili £n(*)(cat(*) - c N ). 

First, it holds that b' N = ^N(i)yN(i) = J2?=i x N{i)yN(i) because J2iLiVN(i) = 0. Hence 
\b'jy | < ||arjv|I 2 Il3/jv|I 2 - But on n An, we know from Step 4 that ||rcjv|I 2 < C||Wn|| 2 , and it 
obviously also holds true that ||2 /jv1 12 < C||^vfe- We thus conclude that E[l n i (-^(b^) 2 ] — 
C'E[||JsT iv ||i] 1 / 2 E[||W 7 v||i] 1/2 = EfllW/vllf] by symmetry. Using finally Step 2-(ii), we deduce that 
indeed, Eflf^n^ (b^) 2 ] — C- Next, since |£jv(*)| < C on by ([7]), we can write |ajy| < 
C\ |cjv — cjvljvlli = CHj/ivIII- We conclude as previously that Efl^n^ {a' N ) 2 ] < C. 

Step 7. The goal of this step is to establish that, for all N > N 0 , 


E 


LfihrUjv 


Ml~ 


A 2 p(l — p) 


(1 - A p) 2 


< 


C 

Vn' 


Starting from Step 3, we write 


xn — A InXn = A AnXn — Ar/vlAr = AAn(xn — A £/vWv) + A 2 £n A^Xn — Ar/vl iv- 


Thus 


||aw — A£jvX/v|| 2 < A| | |-Ajv 11 12 I |a^jv — A£jvW/v|| 2 + A 2 |£/v|||AivX/v ||2 + AW 1 ^ 2 \\Cn — pljvIMI^ivlb, 

where we used that 11 1jv| I 2 = W 1 / 2 and that |r/v| < iV _1 ||Cjv — pi jv1 12 1I^cjv11 2 on D An, as 
checked at the end of Step 3. Using now that A|||-Ajv11 12 < a < 1 and \£n\ < C on and that 
II^jvII 2 < C\\X N \\ 2 on Ujy nA N by Step 4, we conclude that, still on f2jy fl^Ijv, 

\\x N - M N X N \\l<C(\\A N X N \\lA CN~ 1 \\C n - pl N \\l\\X N \\l). 


Since now EfH-Ajv-Xjvlls!] < CN 1 by Step 2-(iv), since E[||X/v||f] < C by Step 2-(ii) and since 
E[||Cjv — pi n 11 2 } < C (see the end of Step 1), we deduce that 


E 


iohnAivll^iv - A£jvWv||2 


C 

< —. 
“ N 


Next, we observe that |||xjv||| - (A£at) 2 ||Wv|||| < \\x N - A£ N X N \\ 2 (\\x N \\ 2 + A|£jv11 |^jv| I 2 ) < 
C\\xn — A£/v^Ajv|I 2 Il-X" jv11 2 on 0.4^ by Step 4 and since £n is bounded on fljy. Hence 


E 


LnUrUjv 


Ml (AM 2 ||^|| 2 |] < ^Le[\\X n \\1]V 2 < -^L 


by Step 2-(ii). To complete the step, it only remains to verify that 


div = E 


L ohnA N 


(£ N ) 2 \\X N \\l-p(l-p)(l-Apy 


< 


c 

VN' 
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We naturally write d n < a'fj +b'f,, where 


L oJv rvW 


(M 2 -(l-A p)- 2 \\X N \\l 


&" =(1 - Ap)" 2 E 




\\X N \\l-p(l-p) 


Step 2-fiii) directly implies that b'L < CN x / 2 . Using that £n is bounded on fib, we deduce that 
|(M 2 - (1 - Ap)“ 2 | < c\i N - (1 - Ap)- 1 !. Thus 


a% < CE 


L ni nA N 


2 - 11/2 

£zv — (1 — Ap) _1 E[| I-X'jv 1 12 ] 1 / 2 . 


Step 2-(ii) and Step 5 imply that a'fj < CN 1 < CN 1 / 2 as desired. 

Step 8. It remains to conclude. It clearly suffices to treat the case where N > N 0 , because 
£jv(*) and Cat(z) are uniformly bounded on Ujy by |7]), so that the inequalities of the statement are 
trivial when N < N 0 (if the constant C is large enough). Since In is (uniformly) bounded on 
we have 

1 2 1 „ r ^ 1 2 n 


E 


In — 


1 — A p 


< E 


L nTru N 


In - 


1 — A p 


CPr((^) c ). 


The first term is bounded by CN 2 (by Step 5), as well as the second one (use the last inequality 
of Step 1 with a = 8). 

Similarly, using Step 6 and that In{1) and cjv(i) are (uniformly) bounded on f Ijy, we see that 


N 


E 


•-n 1 


^^ 4 (*)( cjv (*)) 2 - 


1 


i—1 


(1 — A p) 3 


21 <^+CPr((^n<4- 


N 2 ' 


Finally, observe that Xu=i(-^ jv(*) — In) 2 = INaIII is bounded by CN on Ujy, so that by Step 7, 
N \ 2» 


E 


H ~ ^) 2 - 


A 2 p(l -p) 


i— 1 


(1 - A p) 2 


<_A +CW p r(M „ r) <_|. 


We used the last inequality of Step 1 with a = 6. 


□ 


4.2. Preliminary analytic estimates. In view of ([3]) and Q, it will be necessary for our purpose 
to study very precisely the behavior of which we now do. The following statements may seem 
rather tedious, but they are exactly the ones we need. Recall that ip*°(t — s)ds = S t (ds) and that 
ip* n (s) = 0 for s < 0 by convention. 

Lemma 15. Recall that ip : [0, 00 ) 1 —>• [0, 00 ) and that A = J 0 °° ip(s)ds. Assume that there is q > 1 
such that J 0 °° s q ip(s)ds < 00 and set n = A 1 f 0 °° s<p(s)ds. 

(i) For n > 0 and t > 0, we have f*sip* n (t — s)ds = A n t — nA n n + e n (t), where 

0 < e n (t) < Cn q A n t 1 ~ q and £ n (t) < nA n n. 


(ii) For n > 0, for 0 < t < z and s £ [0, z], we set /3 n (t, z, s ) = ip* n (z — s) — p* n {t — s). Then 


Jo I Pn(t, z, s)|ds < 2A n and for all 0 < A < t and all z £ [t, t + A], 


/3 n (t,z,s)ds 


ft—A 


< Cn q A n t q and 


I Pn(t,Z,s)\ds- 


Pn(t,Z,s)ds 


It-A 


< Cn q A n A~ q . 
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(Hi) Form,n > 0, for 0 <t < z, we put 7 m>n (t, z) = fj fj (s A u)(3 m (t, z,s)/3 n (t, z,u)duds. It 
holds that 0 < 7 m>rl (t,i + A) < A m+ "A, for all t. > 0, all A > 0. Furthermore, there is a family 
K"m,n satisfying 0 < K m>n < (m + n)n such that, for all 0 < A < t, 

lm,n{t, t + A) = AA m+n - K m , n A m+n + e m , n (t, t + A), 

with | Sm, n (t,t + A) | < C(rn + n) q A m+n tA~ q . 


Proof. We introduce some i.i.d. random variables X%,X 2 , ■ ■ ■ with density A ~ 1 ip and set So = 0 
as well as S n = X\ + • • • + X n for all n > 1. We observe that, by the Minkowski inequality, 
E[S q ] < n q E[X(\ < Cn q , since E[X®] = A -1 s q <p(s)ds < oo by assumption. 

To check (i), we use that S n has for density A~ n ip* n , so that we can write 


f s<p* n (t-s)ds = f (t-s)<p* n {s)ds = A n E[(t-S n ) + ]=A n t-A n E[S n ]+£ n {t), 

Jo Jo 

where e n (t) = A n E[(S ra — f)lrs n>t \]. We clearly have that E[5„] = nn, that £„(<) > 0 and that 
e n (t) < A"E[S„] = nA n n. Finally^ e n (t) < A"E[5„l {Sn > t} ] < A n t x ~ q E [5«] < Cn q A n t 1 ~ q . 

To check (ii), we observe that | f3 n (t, z, s)|ds < 2A” is obvious because f 0 °° (p* n (s)ds = A” and 
that, since E[S®] < Cn q , 


ip* n (u)du 


A n Pr(5„ > r) < Cn q A n r~ q . 


We write fj /3 n (t,z,s)ds = f~ip* n (z — s)ds — / 0 * p* n (t — s)ds = f~ ip* n (u)du, which implies 
that \ fj f$ n (t,z,s)ds\ < f t °° (p* n (u)du < Cn q A n t~ q . Next, we see that / 0 * A \/3 n (t,z,s)\ds < 
Jo A P* n (z — u)du + fo A ip* n (t — u)du < 2 ip* n (u)du < Cn q A n A~ q . Finally, using the 
two previous bounds, | ff_ A /3 n (t, z, s)ds| < | fj /3 n (t, z, s)ds| + | f* A (3 n (t, z, s)ds| < Cn q A n t~ q + 
Cn q A n A~ q < Cn q A n A~ q because A € [0, t] by assumption. 

We finally prove (iii) and thus consider 0 < A < t and m, n > 0. We start from 


7 m,n(t,t +A) = 


rt+A ft + A 


(s A u) <p* m (t + A - s)<p* n (t + A - u) + y* m (t - s)g>* n (t - u) 


- v* m (t + A - s)ip* n (t -u)- ip* m {t - s)^ n (t + A - u) 


duds. 


Using another (independent) i.i.d. family Yi .Y 2 ,... of random variables with density A 1 ip and 
setting T m = Y\ + ■ ■ ■ + Y m (or T m = 0 if m = 0), we may write 


7 m,n(t,t + A) =A' 


m+n 


E 


(t + A — T m ) + A (t + A — S„ ) 4. + (t — T m )j r A (t — S n )+ 

— (t + A — T m ) + A (t — S n )+ — (t — T m ) + A (t + A — <SVi)+ 


This precisely rewrites 7 t + A) = A m+ "E[((t + A — T. m V S n ) + — (t — T m A 5 n )+)+], which 
implies that 0 < 7 t + A) < A m+ "A. We next introduce 

Sm,n(t,t + A) = A m+n E[(t + A - T m V Sn) - (t - T m A S n )], 

which is nothing but 5 m ^ n {t,t + A) = A m+ ”(A — K mj „), where K m , n = E[|T m — i5„|] obviously 
satisfies 0 < K m ,n < n(m + n). Thus 7 m ,n(t,t + A) = A m+n (A — n m ,n) + + A), where 
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+ A) = 7 + A) — S + A). Finally, it is clear that, since 0 < A < t, 

| £m,n(t, t + A) | <A m + n (t + A) Pr(T m V S n > t + A or T m A S n > t or \T m - S n \ > A) 
<2A m+ "tPr(T m > A or S n > A). 

This is, as usual, bounded by CA m+n t(m q + n q )A~ q . □ 


4.3. Preliminary stochastic analysis. We handle once for all a number of useful computations 
concerning the processes introduced in Notation [9] 

Lemma 16. We assume H(q) for some q > 1. Recall that and were defined in Notation 
1 1 ;j| and that all the processes below have been introduced in Notation [5| 

(i) For any r £ [l,oo], for all t> 0, 

l n i. ||E 9 [Z*]|| r <Ct\\l N \\ r . 

(ii) For any r £ [l,oo], for all t > s > 0, 


Eg 



(in) For all t > s + 1 > 1, 


lift - s)i N 


< C(1 A S 1 —g ) 11 Itv | |r- • 


sup E@ 


fZ z t ’ N - Zf N ) 2 + sup I Mf N - M l s ’ N I 4 

[s,t] 


Efi 


(z t N -z?y <c(t- s ) 


Proof. Recall ([3|, which asserts that Eg[Z^] = p E n >oL/o sl P* n (t ~ s)ds]Ajyljv. Using that 
fgSip* n (t~ s)ds < tA n , we deduce that ||Ee[Z^]|| r < A"|||Ay|||r ||liv||r- This c l ear ly 

bounded, on by C*i111 tv 11r, which proves (i). 


Cn q A n (t 1 ~ q A 1). Hence 


Using next Lemma 15 (i), E 9 [Zj ] = p^2 n>0 [A n t 


nA n K + £-„(t)]A^ljv, where 0 < e n ft) < 


E 0 [Zf ] - E 0 [Zf ] = pft -s)J2 A n ^liv + M EM*) 

n>0 n>0 


£n(s)]A^ljv 


But E„>0 A n Wfj 1 jv = Qn^-n = £n on fijy. Thus, still on since s < t and q > 1, 


Efi 


zf-z 


N 


- n(t - s)E n < C( 1 A s 1 ^) E 7i 9 A n |||Ajv|||"||lAr|| r < C( 1 A s 1 - 9 )||l JV || r . 


n> 0 


Since [M l,Ar , = Zj ,JV by Remark 10 the Doob inequality implies that Egfsup^j | Mf N — 

M' l s ’ N | 4 < CE.g[(Zl' N — Z l s ’ N ) 2 }. Also, the Cauchy-Schwarz inequality tells us that Eg[(Z t JV — 

Zf) 2 ] < N~ 1 Yffi = i 1 ^B[{Zl’ N — Zf N ) 2 \ < sup i=li ... |iV E 9 [(2j’ JV — Zf N ) 2 ]. Hence we just have to 
prove that sup i=1 ^ N E g[(Zf N — Zf N ) 2 ] < Cft — s) 2 . Recalling that Zf N = Uf N + E g[Zf N ], we 
have to show that, on f2jy, (a) (E g[Z l t ' N ] — E g[Z\’ N ]) 2 < Cft — s ) 2 and (b) E e[(U‘t’ N — U l s ’ N ) 2 ] < 
Cft — s) 2 . 

To prove (a), we use (ii) with r = oo and find that, on E g[Z l t ' N ] — E g[Z l s ' N ] < pft — 
s)IKiv||oo + C||1jv||oo < Cft — s), since £n is bounded on and since t — s > 1 by assumption. 
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To prove (b), we use Q to write U l t ' N - U l s ’ N = E„> 0 foPn(s, t, r) Y?j=\ Av(b j)M^’ N dr, where 
we have set /?„(s, t, r ) = tp* n (t — r) — tp* n (s — r) as in Lemma 15 We deduce that 

pt pt N 

E [(Ui’ N -Ul’ N ) 2 }= Y / Prn(s,t,u)P n (s,t,v)Y A N(iJ) A N(i,k)Ee[Ml’ N M^ N ]dvdu. 

„ JO JO ■ , , 

m,n>0 ' '— 1 


j,fc=l 


By Remark 10 E g[M£’ N M£’ N ] = l{j = f.}Eg[Z^ v ]. Using now (ii) with s = 0 and r = oo, we 
see that x{’ := E g[Z{’ N ] — [iMnU) satisfies sup i>0j - = i ^ \ x t’ N \ < C on iljy. We thus write 

E e [(U l t ’ N - Ul ’ N ) 2 ] =I + J, where 


1 =T Y [ [ Pm(s,t,u)P n (s,t,v)Y A N(h j) a n(^ j)(uAv)£ N (j)dudv, 

m,n>0^° J 0 j =1 

i-t i-t N 

J =Y Prn(s,t,u)p n (s,t,v)Y A N(. i J) A N(iJ) x uAvdudv. 

JO ■ — i 


m,n'> 0 


First, using only that x{’ N is uniformly bounded on and that / 0 f |/? m (s, t, u)\du < 2A m , we 


find |J| < C'Em,n>o Am+ "EyLi^Jv(bi) j 4 Jv(bj) = CEf = i(<5Af(*,j )) 2 on whence |J| < 


iV 


CEjLi(l{i=j} + N 2 ) 2 by d8l. We conclude that |J| < C < C(t — s) 2 . Next, we realize that, 
with the notation of Lemma [15]- (iii), 


N 


1 = M Y 7m,n(s,t)^A^(i,j)A^(i,j)^iv(j)- 

m,n>0 j=l 


But we know that 0 < 7 m ,n(s,t) < A m+n (t — s). Hence I < fj,(t — s) Ylj=i(Qiv{i, j)) 2 (-N(j) < 
C(t — s), since £n is bounded on fand since, as already seen, J2j=i(QN(.i, j)) 2 is also bounded 
on We conclude that E e[{Ul' N — U^’ N ) 2 } < C(t — s) < C(t — s ) 2 on as desired. □ 


4.4. First estimator. We recall that £f = ( Z — Z^)/t, that the matrices A^ and Qpf and the 

as well as i N (i) = J2jLi QN{i,j) and l N = N~ x Yh=i ^v(*)- 


event were defined in Notation 


12 


The goal of this subsection is to establish the following estimate. 
Proposition 17. Assume H(q) for some q > 1. Then for t > 1, 


Eg 


St - 


< c 


:*+*)■ 


We start with the following lemma (recall that U N was defined in Notation [ 9 ]) . 
Lemma 18. Assume H(q) for some q> 1. Then on f2]y, for t > 1, 

E e[S t N ] - [it N < Ct~ q and E g [\U t N \ 2 ] < CtN- 1 . 


Proof. Applying Lemma 16 (ii) with r = 1, we immediately find, on 


e e [e?]-id N 


< N~ 


Eg 


K - z, 


JV-, 


- /i£n 


< CN~H~ q llivlli =ct~ q . 


Next, we deduce from Q that = N 1 En>o — s ) Eij-i a n(.T j)Mp N ds, whence 
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by the Minkowski inequality. But recalling Remark 10 i.e. E q[M 3 s ’ n M l s ’ N ] = l^j = iyEg[Z J s ’ N ], 


N 2 N N 2 N 

e«[( E ] =E M z i' N \ < iPivii^E^^] 


ij =1 

We know from Lemma 


16 


i=i i=i j=i 

(i) with r = 1 that XEi < CJVs on Hence, still on Sljy, 


__ rt CP/^ - _. 

M\U t N \ 2 } 1/2 <^E infill? / w E A ‘ 

n> 0 ''° n> 0 


„ , Cl' 72 

1 - IV 1 / 2 


as desired. 

We can now give the 

Proof of Proposition |17| It suffices to write 


□ 


Eg 


£? - N 


< 2E e 


£ t N -E e [£?] 


N^ 


E B [£?]-ne N 


and to observe that \£^ — Eg[£^ ]| = | U£. — U^\/t < \Ufl\/t + \U^\/t, whence finally 

2i 4 _ _ __ „ _ 2 


Eg 


£t - V*N 


< 


N 121 


E e [\U t N \ 2 ]) + 2E 9 [£^]-pe N 


N] 


Then the proposition immediately follows from Lemma [Ts] 


□ 


4.5. Second estimator. We recall that V t v = — Z l t ,N )/t—£^] 2 — N£j*/t where = 

(Z 2 t —Z™)/t, that the matrices Am and Qn and the event were defined in Notation 


12 


as well as 

^iv(*) = J2j=i QN(i,j) and l N = N~ x XEi ?n {*)■ We also introduce V* = \x 2 EiIi^Jv(*) ~^v] 2 - 
Proposition 19. Assume H(q) for some q > 1. Then for t > 1, a.s., 


Eg 


V N _ V A 
v t K oo 


Observe that the term XEi[^v(*) ~ ^v] 2 will n °t cause any problem, since its expectation 


< 


N 

C^l + E |Vn(*) — In 


2 = 1 
12 


2 \'/2/AT VN 1 


(restricted to is uniformly bounded, see Proposition 
We write |V^ — V^| < A^' 1 + A^’ 2 + A^’ 3 , where 

N N 


14 


Af ’ 1 E[(^f - z l t’ N )/t - £?? - EK^f ^ Zt N )/t ~ 
2=1 2=1 

=1 Et(^f - ^ ,JV )A - Mi)} 2 - iw?7i 2 


A 


N,2 


2=1 

AT 


A 


AT,3 


=2 E[(^f - #")/* - - /^v] 


2=1 
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w 4. -4. \N,2 ^ a Af,21 , A N,22 . a AT,23 i 

We next write A t < A t ’ + A, ’ + A,’ , where 


Af’ 21 = 


E [(4" - z t N )/t - E fl [(Zjf - Zj’^/t]] 2 - N£ t N /t 


i— 1 

Af’ 22 =E - ^t ,iV )A] - mMO 


2=1 


AT 


Af ’ 23 =2 


E [(^f - #")/* - E A(^f - ^t ,JV )A]] - mMO' 


2=1 


We will also need to write, recalling that U)’ N = Z\’ N — E g[Z l t ' N \, 


Af’ 21 = 


N 2 

E [(^f - ££'*)/*] - Aff A 


2=1 


< A t 


A,211 , a AT,212 


+ A 


-A. 


AT,213 


where 


N 


aA 211 = 

£{(< 


2=1 


N 

aA 212 = 

Ee, 


2=1 

aA 213 = 

N£?/t 

use that A^’ 3 < L 


rtf u- N 


u i 2 f u\’ N 


?N , 


— Efl 


u& N -ui' N )/t) ]}|, 


- Eg{N£?/t] 


Af’ 31 =2 


A A 32 =2 


7 2, Ax 


E [(z l 2 f - zi' N )/t - e 0 [{zif - zi’ n )/t)\ y^t N {i) - v* N 
2=1 
AT 

E [E 9 [(Zl’ t N - Zi’ N )/t\ - v.1, v(t)] [^(i) - mAv 


rrn . l i-i i a AT,1 a AT,211 A AT,212 a AT,213 A N.22 A N, 23 A Af,31 i \N.32 

lo summarize, we have to bound A t , /\ t , A t , A t , A t , A t , A £ and 

Only the term A^’ 211 is really difficult. 

In the following lemma, we treat the easy terms. We do not try to be optimal when not useful: 
for example in (iv) below, some sharper estimate could pro bably be obtained with more work, but 
since we already have a term in N x ! 2 t~ x (see Lemma 241, this would be useless. We also recall 
that we do not really try to optimize the dependence in q: it is likely that t~ q could be replaced 
by t~ 2q here and there. 


Lemma 20. Assume H(q) for some q > 1. Then a.s. on OL, for t > 1. 

C^eaaA 1 ] ^CiNt-^ + t- 1 ), 

(ii) E 0 [AA 22 ] < CNt~ 2q , 

(in) E e [AA 23 ] < CNt~ q , 

(iv) E e [AA 213 ] < CA 1 /^- 3 / 2 , 

(v) E s [AA 32 ] < CNt~ q . 
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Proof. We work on Hjy during the whole proof. 

Using that = N ” 1 ~ Z\ N )/t\, one easily checks that A^’ 1 = N\£™ — hInY 

Thus point (i) follows from Proposition 17 


Next, we observe that A^' = ||Eg[(Z^ — Z^)/t\ — /j,£n\\%. Applying Lemma 16 (ii) with r = 2, 

N 
t 


we conclude that indeed, A^’ 22 < Ct 2q \\lN\\ 2 = CNt. 2q . 
We write 


A,23 


< 2 


(Zg-Z?)/t-E e [(Z«-Z?)/t] i E fl [(Z&-Z ?)/t]-ni N 


Applying Lemma 16 (ii) with r = oo, we deduce that ||E@[(Z^ — Zj)/t] — h£n\\oo A Ct 9 . Lemma 
(i) with r = 1 gives us that E 9 [||(Z^-Zf r )/t-E 9 [(Z^-Z^)/t]||i] < 2f- 1 ||E e [Z^+Zf]|| 1 < CN. 


16 


We thus find that indeed, E@[A^' 23 ] < CNt q . 

Since _Af’ 213 = (N/t)\£ t N - E e [£ t N ]\ = Nt~ 2 \U£ - U t N \ < Nt~ 2 (\Ug\ + \Uf |), we deduce from 
Lemma 


18 


that E^Af’ 213 ] < CNt~ 2 ^/tjN = CN V 2 *- 3 / 2 . 


Finally, starting from A^’ 32 < 2^||Eg[(Z^ — Z^)/t] — H^n\\oo\\^n ~ ^a1a||i and using that, 
as already seen when studying A^’ 23 , |jE@[(Z^ — Z ^)/t\ — \xl a||oo < Ct~ q , we conclude that 
Af’ 32 < Ct~ q \\£N — /jvlivlli < CNt~ q , since In is bounded (see Q) on f1^. □ 

Next, we treat the term A^’ 212 . 

Lemma 21. Assume H(q) for some q > 1. Then a.s. on fljy, for t > 1, EgfA^ -212 ] < Ct 


-l 


Proof. We work on fl]^. Recalling that N£™ = t 1 i(-^ 2 t ), we may write Eg [A, ]< 

t~ 2 J2iLi a ii where oq = \Eg[(U 2 t N — Uf N ) 2 — (Z^t* ~ Z‘ l t ' N )\\. Now we infer from Q that Uf N = 

M t N + £„>i IoT* n (t ~ s) J2f=i A N^j) M s N ds, so that U 2 f - Uf N = M^f - Mf N + R \' N , 
where 


R 


i,N 


= E 

n> 1 1 


r 2t 


N 


p n {t,2t,s)Y, A N(h3)Mi' N ds. 
l=i 


We have set f3 n (t,2t,s) = ip* n (21 — s) — ip* n (t — s) as in Lemma 15 and the only thing we will 


use is that J^ \/3 n (t, 2t, s)|ds < 2A”. Recalling that M l ’ N is a martingale with quadratic variation 


[M l ’ N , M l,N ] t = Z\’ N , see Remark 10 we deduce that Eg^M^ — Ml’ 1 ' 1 ) 2 ] = EgfZ^™ — Zf ,ls \. 


i,N 


fAl2l _ 


yi,N 




Hence 

at = Ee[(i?( ,Ar ) 2 ] + 2E e [(M l 2 ' t N - M 1 t ’ N )R l t ’ N ] = h t + d u 
the last equality standing for a definition. We first write 

r 2t r2t n 

/ p m {t,2t,s)p n (t,2t,u) V A%(i,j)A n N (i,k)E e [Mi’ N M*’ N ]duds. 

3 Jo i,fc=i 


b i= T, 

m,n>l' 


But we know that E q[M^ n M^ ,N ] = l{j= k yEo[Z J s \ u ] by Remark 10 and that E e[Z J s \ u \ < Ct on 
fl]y by Lemma 16 (i) (with r = oo). Hence 

N N 2 

bi<Ct Y. Am+n Y A N(i,j) An N(i,j)=CtY(Y AnAn ^d)) ■ 


1>1 


1=1 


1=1 n> 1 


But E „>1 A ”^Ar(bi) = QN(i,j) - l{i=i} < CN on by 0, so that bi < CtN 


T~ 1 
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Next, we start from 

_ ,-21 N 

< = P n (t, 2 1, s) ^ A^(i,j)E e [(M^ N - Ml' N )Mi’ N ]ds. 

ra>l"'° 3=1 

As previously, we see that E g\(M^ N — Ml' N )Mf' N ] = 0 if i ^ j and that Ee^M^ — Ml’ N )M l s ' N ] = 
Eg[Z^ ias — ^tAs] — C* on (by Lemma fl6^ (i) ), whence 

di < Ct 53 A"A^(i, i) = Ct(Q N (i, i) - 1) < CtTV" 1 

n>l 

on fijy- by Q again. Finally, a, < CtN -1 , so that Ee[A^’ 212 ] < t -2 J^iLi a i — Ct -1 on fljy. □ 


We next compute some covariances in the following tedious lemma. 

Lemma 22. Assume H(q) for some q > 1. Then a.s., on Oy, /or all t > 1, all k,l,a,b £ 
{1,..., TV}, all r, s,u,v £ [0, t], 

(i) |Cov e (Z^,Z'^)| = |Cov 9 (17*-^,C#*)| < Ct(N~ 1 + l {k=l} ), 

(zi) |Cov e (Z*’ N ,Ml’ N )\ = |Covg (Uf’ N ,Mf N )\ < C^TV" 1 + l {k=l} ), 

(in) |Cove (Zk’ N J 0 s M l T ?dM l T < N ) \ = |Cov e M 1 ^ dM l T ^ N )\ < Ct 3 / 2 (fV 1 + l {k=l} ), 

(iv) |E e [M*’ N M*< N M}; N ]\ < CN~H if#{k,l} = 2, 

(v) |Cov e (M r fe ’ JV M'- JV ,M“’ JV M^ JV )| = 0 if#{k,l,a,b} = 4, 

(vi) |Cove (M*’ n M*' n ,M2 n M*’ n )\ < CN~ 2 t if#{k,a,b} = 3, 

(vii) |Covg (M]?’ N M()’ N , M“ ,iV M“’ JV )| < LCV" 1 / 3 / 2 if#{k,a} = 2, 

(viii) |Covg (M?’ N M l s ’ N ,MZ’ N M%’ N )\ < Ct 2 without condition. 

Proof. We work on fijy and start with point (i). First, it is clear, since U^’ N = Z t fc ' W — E g\Z^’ N \, 
that Cove , Zg ,Ar ) = Cove (Uf’ N , U l s ’ N ). Then we infer from ([I]) that 

Cove (U?’ N ,U l s ’ N )= 53 f r^tr-x^s-y) 53 A%(k,i)A n N (l,j)Cov e , M^dydx. 

0 «/0 • • i 

ra,n> 0 z,j=l 


But we know (see Remark 


16 (i) (with r = oo). Thus 


10) that Cove (M* 


IV 




N\ 


) = l{i=j}E 9 [Z*’^,] < Cl {i=i} t by Lemma 


N 

|Cove [U^ ,N , U l s ,N )\ < Ct 53 A m +"53 A%(k,i)A n N (l,i) 

m,n> 0 i =1 


N 

Ct 5Z Q N (k, i)Q N {l, i)- 

i= 1 


Recalling (§, E,=i Qiv(M)Qiv(M) < + l^KiNT 1 + l {l=i} ) < C(N~ 1 + l {fc=;} ). 

Point (i) is checked. 

For point (ii), we again have Cove (Z!f’ N , M l s ’ N ) = Cove (Uf ,N , M l s ’ N ) and, using again Q, 

nr N 

Cove (U?' N , M l s ’ N ) = 53 / tp* n {r - x)J2 A n N (k, i)Cov e (K’ N , M l s ,N )dx. 

n> 0"'° t= 1 
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Since |Covg (M X ’ N , M l s ’ N )\ < Cl{ i= i}t as in (i), we conclude that 

|Cov, (U k ’ N ,M l s ’ N ) | < Ct^2 A n ^(fc,i) = CtQ N {k,l ) < Ct^N -1 + l {k=l} ). 


n> 0 


Point (iii) is checked similarly as (ii), provided we verify that |Cov 0 (M X ,N , M x _ dM x ,N )\ < 
Cl{ i= i}t 3 / 2 . This is obvious if i l because the martingales M l ’ N and f 0 dM l T ' N are orthog¬ 
onal, and relies on the fact, if i = l 7 that 

2i 1/2 


Covt 




M l r ’*dM: 


i.N 


< E e [\M l x : N \ 2 } 1/2 E 6 


M'^dM, 


i.N 


10 


< ct 3/2 . 


and Lemma 


16 


The last inequality uses that E@[|M* ,JV | 2 ] = E g[Z x ’ N ] < Ct by Remark ^ 

(i) and that E#[| / Q s M x ^dM*’ N \ 2 ] < Ct 2 . Indeed, we have [/ 0 M x ffdMp N , f Q M x ^dMp N ] s = 
fo (M*’^ ) 2 dZl’^ < (Mi’ N ’*) 2 Zl’ N , whence 


Eg 


M^dM. 


i.N 


< E e [(M l s ' N ’*) 2 Zi’ N ] < E 0 [(Mj’ w ’*) 4 ] 1 / 2 E 0 [(Z^) 2 ] 1/2 , 


which is bounded by Ct 2 by Lemma |l6] -(iii). 

For point (iv), we assume e.g. that r < s and first note that 

E g[M*’ N M*’ n M\i n ] = Eg [M k,N E 9 [M k,N M^ n |J>]] = E e [(M k ’ N ) 2 M l ^ r ) 

because the martingales M k - N and M l,N are orthogonal. Since [M k,N , M k,N ] r = Z k,N , it holds 
that (M k,N ) 2 = 2 J Q r M k '^dM k ' N + Z k ’ N . Using that f Q M k '^dM k,N and M l,N are orthogonal, we 

conclude that E 9 [(M k,N ) 2 M^ r ] = E g[Z k,N M^ r \ = Cov 9 (Z k,N , M^ r ). Since k ^ l, we conclude 
using point (ii). 

Point (v) is obvious, since when k,l,a,b are pairwise different, the martingales M k,N , M l,N , 
M a,N and M b,N are orthogonal. 

Point (vi) is harder. Recall that #{fc, a, b} = 3, so that clearly, Co vg (M k ’ N M k,N , M“’ N M b,N ) = 
E e[M k,N M k,N M®' N M b,N ]. We assume e.g. that r < s and we observe that 

E e [M k ’ N M k ’ N M£' n M b ’ N ] = E 0 [M k ’ N E e [M k ’ N M^ N M*< N \F r \\ = E 9 [{M k ' N ) 2 M^ r M h v ^ r ] 

because M k ’ N , M a ’ N and M b ’ N are orthogonal. We thus have to prove that for all r, u, v G [0, t] 


\,N 


7k. N 


with u,v < r, \E e [(M k ’ N ) 2 MZ’ N M b ’ N ] \ < CN~ 2 t. We write (M k ’ N ) 2 = 2 f Q r M k C dM k 
as in the proof of (iv). The three martingales f Q M k ' N dM k,N , M a,N and M b,N being orthogonal, 
we find Eg[(M k ’ N ) 2 M£’ N M b ’ N ] = E e [Z*’ N M£ N M*< N ] = E e [U*< N M£ N M*< N ]. We next write, 
starting again from Q, 

nr N 

E 9 [U k ’ N MZ’ N M b ’ N ] = J2 / <P* n (r ~x)Y^ A n N (k,j)E 9 [M^ N M^ N M b ’ N ]dx. 

“ 0 a —i 


n>0 1 


3 =1 


But \E 9 [Mi ,N M“ , n M b,N }\ is zero if j ^ {a, b} because the martingales M^ ,N , M a ’ N and M b ’ N are 
orthogonal, and is bounded by CN~ l t else by point (iv). As a consequence, 

IE# [U k ’ N M® , n M b,N ] | < CN~HJ2 A n (A^{k,a) + A n N {k.b)) = CN~ 1 t(Q N (k, a) + Q N (k, b)). 

n> 0 


Since k ^ a and k ^ b, this is bounded by CN 2 t by 
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For (vii), we assume e.g. that r < s and u < v and we recall that k ^ a. We have 
Cov e M®’ n M“ , n ) 

=Co v e ((M*’ N ) 2 , {M? N ) 2 ) + Cove {M*’ N (M*' N - M*’ N ), 

+Cove M£ ,n (M® ,n - M“’ iV ))+Cove {M^ N (M^ N - M*’ N ),M£ N {M? N - M°' N )) 

=1 + J + K + L. 

First, L = 0. Indeed, assuming e.g. that r > u, we have 

L =Ee[M r fe ’ JV (M s fe ’ JV - M r fe ’ iV )M“’ JV (M“’ JV - M“ ,JV + M“ >JV - M“ iJV )] 
=Ee[M r fe ’ JV M“’ JV Ee[(M s fe ’ JV - M r fe - JV )(M“’ JV - M“ ,JV )|.7>]] 

+ E e - M“’ JV )Ee[M s fc ’ iV - ,JV |J>]] 

and in both terms, the conditional expectation vanishes. Next, we write as usual (M^ ,N ) 2 = 
2 fy M*'*dM*' N + Zf’ N and {M“’ N ) 2 = 2 /“ M*’™dM“’ N + By orthogonality of the mar¬ 
tingales f Q dM*’ N and f Q dM“ ,JV , we find 

I = Cove (Z*>* Z“’ w ) + 2Cove J M?^dM?’ N ^ + 2Cov g ( J M^dM^ N , Z“’ w ). 

We deduce from points (i) and (iii), since k ^ a, that |/| < C(N~ l t + TV^t 3 / 2 ) < CN _1 £ 3//2 . We 
now treat K. It vanishes if u > r, because E g [M£’ N — M° l ’ N \J r u ] = 0. We thus assume that u <r. 
We write as usual (M*' N ) 2 = (M*’ N ) 2 + 2 f u M^dM^ N + Z^ N - Z*' N and 


M*'*dM‘ 


fc,A^ M a,N( M a,IV _ M a,N} 


K =E e [{M*' N ) 2 M°’ N (M«' N - M“' N )\ + 2E 
+ E g[{Z*’ N - Z*’ n )MZ’ n {M2’ n - M“ ,JV )]. 

The first term vanishes (because Eg[M“ ,JV — M^ N \T U ] = 0), as well as the second one (because 
Eg[(/J" dM^’ N )(M^' N — MZ N )\F U \ = 0 by orthogonality of the involved martingales). Con¬ 

sequently, 

K = E o[(Z?’ N - Zl' N )M“' N {M %' n - M“' N )\ = Ee[( U*' N - U^ N )M^ N (M^ N - M“ ,JV )]. 
Using Q and recalling that /3 n (u,r,x) = tp* n {r — x) — ip* n (u — x), we find 

,r N 

* = £ / Pn(u, r, x) £ A n N (k,j)E g [M^ N M^ N (M^ N - M“>")]da;. 

n> 0"' 0 i=l 

< CAT-U if a ± j by (iv), while |E g [M^ N M^ N (M^ N - 
1^| (iii). Thus 

N N 

\K\ <c£A” \A n N (k, a)t 3/2 + £ A” (fc, j)^ _1 i] < C [Q N {k, a)t 3 / 2 + A^" 1 £ Q N (k,j)t . 

n>0 i=1 J=1 

But Ap a implies that Q]y(k,a ) < CW _1 by (|8]), while -/V -1 Qpfc, j) < C'AT -1 111 Qtv 111oo < 
ON -1 . As a conclusion, |/\ | < CW -1 ^ 3 / 2 +£) < GW -1 ! 3 / 2 . Of course, J is treated similarly, and 
this completes the proof of point (vii). 

Point (viii) is obvious: it suffices to use the Holder inequality to find 
|Cove {M*' N M l s ' N ,M«' N M b v ' N )\ < Ee[(M) fc ’ Ar ) 4 ] 1 / 4 Eepfi’ Ar ) 4 ] 1/4 Ee[(M“’ Ar ) 4 ] 1 / 4 Eepf„ b ’ Ar ) 4 ] 1/4 , 


But |E e [Ml' N M*' N (M“ ,Ar - M“ ,JV ) 
M“ ,JV )]| < Ct 3 / 2 if a = j by Lemma 
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which is bounded by Ct 2 by Lemma 16-(iii). 

We can now easily bound A^’ 31 . 

Lemma 23. Assume H(q) for some q> 1. Then a.s., on fort > 1, 

N 


□ 


E 0 [(Af’ 31 ) 2 ] < Ct- 1 Y, [MO - *n 


Proof. We first note that 


Af' 31 = 2 M r 1 | Y [u l 2 f - ul' N ] [e N (i) - l N 


i =1 


Since U 2t N — Uf N is centered (its conditional expectation Eg vanishes), 


E, 


e [(Af’ 31 ) 2 ] = V^ 2 Y [*i v(<) - *n] [Mi) - 4r]Cov e (C/V - Ul' N , U’f - U’> N ). 


i,j =1 


1 2 


AT 


(l { i= i} + iV" 1 ) = CC 1 Y |M*) - In 
2=1 


1 2 


Using now Lemma 22 (i), we deduce that |Cov@ ( U 2t N — Uf N , U%’ t N — U{' N )\ < Ct(l{i = jy + A” 1 ) 
on Off. Using furthermore that [ijv(f) — -W(j) — V < [tbv(*) — ^v] 2 + [Uv(j’) — &n] 2 and a 
symmetry argument, we conclude that 

N _ _ 0 JV 

E,[(Af’ 31 ) 2 ] < Ct- 1 Y [M*) - 

i,j =1 

which was our goal. □ 

We can finally estimate A^’ 211 . 

Lemma 24. Assume H(q) for some q > 1. TTien a.s., on fl)y, /or i > 1, Ee[(Af r ' 211 ) 2 ] < CNt~ 2 . 
Proof. We as usual work on We first note that E 0 [(Af r ’ 211 ) 2 ] = i -4 Yl!ij =i a o> where 

= Cov* ((t/’f - t/V) 2 , {Ulf ~ Ui’ N f). 

But recalling Q and setting ajv(s, t, i, k) = S ra>0 ^-iv(b k)[ip* n (2t— a)— tp* n (t— s)] for all 0 < s < 2f 
and i, k £ {1,..., A}, 

(9) 


ff - ff = 


r2t N 

Y^ a N{s, t, i, k)Mg' N ds. 

0 k =1 


Concerning a^v, we will only use that, on Q]y, 


( 10 ) 


p2t 

/ |ckjv( s, t, i, k)\ds < 2 A n Aff(i, k) = 2Qjy(i, k) < (7(1^=^,} + A 3 ), 

"'° n>0 

the last inequality coming from ([8]). A direct computation starting from © shows that 


N 


r 2t r 2t p2t r 2t 


= E 

k,l,a,b =1 


/0 JO JO JO 


a N (r, t, i, k)a N (s, t, i, l)a N (u , t,j, a)a N {v, t,j , b ) 

Cove (M*’ N M l s ’ N , M“' n M b v ' N )dvdudsdr. 
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Let us now denote by T kt i >aib (t) = sup r s u „ 6[0j2t] |Cov e (M*< N M l s ' N , M£ N M%’ N )\. We can write, 
recalling (101, 

N N 

£ dij < C ^ (!{*=*} + N 1 )(1{,; = ;} + N 1 )(l{j =a } + N 1 )(l{j=fc} + N 1 )r k,l,a,b(t)- 

i,j=l i,j,k,l,a,b= 1 

Using some symmetry arguments, we find that ^fj=i a ij — C[R\ + • • • + Rd)^ where 

N N 

i?i = iv- 4 51 T k,i, a ,b(t) = n ~ 2 55 r*, Ii0 , 6 (t), 

i,j,k,l,a,b=l k,l,a,b= 1 

N N 

R .2 = N~ 3 55 1 {i=k}^k,l,a,b{t) = N~ 2 55 r k,l,a,b(t ), 

i,j,k,l,a,b =1 k,l,a,b= 1 

AT AT 

R 3 = N ~ 2 55 l{i=k}l{j=a}rfc,J,a,&(i) = A r_2 5Z 

i,j,k,l,a,b= 1 fc,Z,a,£>=l 

AT AT 

Ra = n~ 2 55 i{i=fc}i{i=z}rfc,*,a,&(i) = -iv -1 55 r fejfc;ai& (t), 

i,j,k,l,a,b= 1 fc,a,6=l 

AT AT 

R5 = N^ 1 5Z l{i=k}l{i=i}l{j=a}rfc,Z,a,b(i) = 55 U.k,®,^)? 

i,j,k,l,a,b= 1 /c,a,6=l 

AT AT 

-^6 = ^ ^ l{j=a} r/c,Z,a,6 (^) = ^ ^ Ffc,fc,a,a(^)- 

i,j,k,l,a,b—l k,a= 1 


Using Lemma 22 (v)-(viii), from which I\z ja ^(f) < we deduce that R± = R 2 = 

R 3 < CNt 2 . Next we use Lemma 22 (vi)-(viii), that is Tk,k,a,b{t) < C'(l{#{k,q,b>= 3 >-N~ 2 t + 
!{#{fc,a,b}< 3 }^ 2 )i whence -R 4 = R 5 < Ct + CNt 2 < CNt 2 . Finally, we use Lemma 22 (vii)-(viii), i.e. 
rk,fc, a ,a(i) < U(l{#{fc,a}= 2 }A _ 1 f 3/2 + l {#{fcia}= 1 }f 2 ) and hnd that R 6 < CNt 3/2 + CNt 2 < CNt 2 . 
All in all, we have proved that Ef^i a ij A CNt 2 , which completes the proof. □ 


We can finally give the 

Proof of Proposition\lS\ It suffices to recall that \V^ — V^| < A^’ 1 + A^ -211 + A^’ 212 + A^’ 213 + 


A 


N,22 _j_ ^N,23 a AT 31 A iV,32 


A 


+ A 


and to use Lemmas 


@0 


23 


and 


24 


this gives, on SP N , 


E«[iv," - v"n <-c(ff + t + » + ^ + [£>(0 - *4^ + Nil). 


Recalling that t > 1, the conclusion immediately follows. 


□ 


4.6. Third estimator. We recall that, for A > 0 such that t/( 2A) is an integer, we have set £, = 
(■ zit-zn/t , zg t = ( N/t ) E^Vi^A-^-DA-Aff] 2 and = 2Z^ >t -Zg t . The ma¬ 


trices Ajv and Qn and the event fl 3 N were defined in Notation 12 as well as tjv(f) = E^Li Qiv(bi) 


3 =l 


and Civ(*) = Ej=i Qn{j, *)• We finally introduce W^ i00 = /UV 1 Ei=i ^Jv(*)(cat(*)) 2 . The aim of 
the subsection is to verify the following result. 
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Proposition 25. Assume H(q) for some q > 3. Then a.s., for t > 4 and A £ [l,f/4] such that 
t/( 2A) is a positive integer, 


Ini Ee 


Wa , - W N 

' v A.t r K oo,oo 


<C[ \l- + 


A t 

+ 


t A (9+ 1 )/ 2 A 9/2+1/ 

Recall that we do not try to optimize the dependence in q. We first write 

~> N A n N ’ 2 o n^- 2 n N ’ 3 , on N ’ 3 nA 4 


- W" J < + 2 D^ t + D^t + 2 D^ t + + 2 D^ t + D%, 


where 




24/A 

E 

a=£/A+l 


47 JV 47 iV a 

^aA ^(a-l)A 


2t/A 


E 

a=i/A+l 


- Z»_ 1} a - A^* 


1 2 


nA2 - 
^A.t 


2t/A 2 2£/A 

^ Xa-^-da-A^ - £ 


E 

a=t/A+l 


ry N ryJM TT 7 < f ry ry f\ 

^aA ~ ^(a-l)A _ E ^Ka _ Z (a-1)AJ 


a=t/A+l 


n A,3 

^A,i — . 


24/A 

E 

a=£/A+l 


iV yiV TT 7 * r 47 N ryfSJ 

^aA ~ A {a- 1)A _ ^Ol^a A ~ ^{a- 1)aJ 
2t/A 


- Ee 


E 

a—4/A+l 


ry iV 47 iV TT7’ [ 47 iV 47 iv 

Z aA ~ ^(a-l)A _ ^raA “ Z (a-1)AJ 


1 2n 


d na - 

U is. ,4 — 


27V „ 


-E fi 


4/A 


E 

a=4/(2A) + l 


A_ 

J Ee 


ryj\ ryj\ Trp r ry ryl\ 

A 2aA ^2(a-l)A Jfij 0[^2aA ^2(a-l)Al 

24/A 


1 2-] 


. E 

a=t/ A+l 

We treat these four terms one by one. 


47 J\ ryfSJ -rut [ 47iV ryJ\j 

Z aA ~ ^(o-l)A _ “M^aA “ Z (a- 1 )aJ 


- w. 


N 


Lemma 26. Assume H(q) for some q > 1. TTien a.s. on O'y, /or 1 < A < t, E#[.D a ’j] < 

CA[r 1 +Ar 2 «], 

Proof. Using that (A /t) E^a+iC^a ~ = AS?, we find that 

Kt = - A ) 2 = NA(jjIn - ff) 2 , 

whence, on f2]y, see Proposition [17J Eg[.D A ’j] < CN A(t~ 2q + (At) -1 ) < CA(Nt~ 2q + t~ l ). □ 

The second term is also easy. 

Lemma 27. Assume H(q) for some q> 1. Then on fijy, for 1 < A < t, Eg[.D A ’ 2 ] < CAt 1-9 . 
Proof. Using that |(A — x ) 2 — {A — y) 2 \ < \x — y\[\x\ + \y\ + 2\A\), 


A 


24/A 


a—tj A+l 


<f< T E A^-E fl [Z* A -Z£_ 1)A ] A M ^ + E 0 [^ a -^_ 1)a ] + 2(Z^ a -^_ 1)a ) 
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whence 


£*[<’?]< T E A/i^-E fl a-Z£_ 1)A ] Ap£ N + 3E e [Z? A - Z»_ 1)A \ 


2t/A 


a=t/ A+l 


But we deduce from Lemma 16 -(ii) with r = 1 that, since (a — 1)A > t, 

A^! n - E g [Z N aA - ^_r) a] | < Ct^, 

whence also Eg[Z^ A — Z^_^ A ] < ApI n + Ct l ~ q < A pIn + C. We conclude that 


N 


2t/A 


MD A : 2 t }<C- E t 1_9 [4A M € JV + C' 

a=t/A+l 

Since In is bounded on and since A > 1 > t 1-9 , we find Eg[D A ’^] < C{N/t){t/A)t 1 ~ q A 
CAY 1 " 9 . 

To treat D A ’^, we need the following lemma. 

Lemma 28. Assume H(q) for some q> 1. Almost surely on for all 1 < A < x/2, 

Yar e (U? +A - Uf) = §W^ j00 - X N + r N (x, A), 

where Xn is a <r((dij)i t j-i t ^ : N)-n r ieasurable finite random variable and where rN satisfies, for some 
deterministic constant C, the inequality |r/v(£, A)| < CxA~ q N~ 1 . 

Proof. We set V£ A = Var g (U* +A - Ufff). 

Step 1. Recalling Q and setting /?„( x, x + A, s) = ip* n (x + A — s) — ip* n (x — s) as in Lemma 
[T5| we get 

rx-\-A N 

u?+ a - u? = E / &(*. *+ A ’ s ) iV_1 E mi’ N ds. 


n>0 1 


i,j=l 


N 


Hence 

/*a:+A /^ai+A - iV 

= E / / + A, r)/3 n (a:, x + A,s)N~ 2 E A ^(i,j)A 1 f / (k,l) 

m,n>0d 0 ^0 i,j,k,l=l 

Covg (. Mi’ N ,M l s ’ N )drds. 

Using Remark |To| we find 


<A= E 


/»a;+A />x+A 


AT 


ra,n>0 


/0 ^0 


/3 m (x,x + A,r)/3 n (x,x + A,s)N 2 E A iv(bj)E e [Z^]dr-ds. 


Step 2. Here we show that E g[Zf N ] = p£n{J)s — Xj + Rj (s), with, for some constant C, for 
all j = 1,...,N, 

0 < Xf < C and \R?(s)\ < C^s 1 " 9 A 1). 

•yN 


By ([3]), we have E o[Z 3 a ' N ] =/^En>o(/o Sf ^ n ( s_r W Ez=i^iv(J>0> whence by Lemma 15-(i), 

N 

Eg[Zi’ N ] = p E( A " S - + ^( s )) E A n(p 0 = mM.7> - xf + R?{s). 


n>0 


1=1 


vi □ 
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We have used that ^ n>0 A n Avli 0 = ^iLiQnUJ) = Uv(j) and we have set XA = 


N 


V K Y,n>o nAn T, 1 ^! A nUi 1 ) and R f( s ) = vT, n > 0 Zn(s)J2?=i A Nti, 1 )- We obviously have 0 < 
Xj* < fjLhi ^] n >o riA n 111^4 tv 111oo < C on and, since £ n (s) < Cn q A"(s 1-9 A 1) by Lemma 15 (i), 
\R?(s)\ < C(?~ q A 1) En>o n9 A n |||Ajv|||” < C(s l - q A 1), still on 

Step 3. Gathering Steps 1 and 2, we now write Vj? A = I — J + K, where 

rx+A px-\-A N 

/ = E 

m,n>0 


N 


/3 m {x,x + A,r)/3 n {x,x + A,s)N 2 22 A^(i,j)A^(k,j)p£ N (j)(r A s)drds, 

ij^k—l 

J=22 l j /3 m {x,x +A,r)(3 n (x,x +A,s)N~ 2 22 A N(hj) A N( k J) x 2 drds ’ 

m,n> 0 ^ ® i,j,k =1 

t*x-\-A px-\-A N 

K = y / / /3 m (x,x + A,r)/3 n (x,x + A,s)N~ 2 22 A^(i, j)A^(fc, j)i?^(r A s)drds. 

™ 0 J 0 ■ ■ ?„—i 


ra,n>0 




•Step Here we verify that |J| < Ca; 2? iV 1 on Ujy. Using that | fJ +A /3 m (x, x + A,r)dr| < 
Cn q A n x~ q by Lemma 15 (ii) and that X R is bounded by Step 2 (and does not depend on time), 

N 

\j\<c 22 m q n q A m+n x- 2q N- 2 22 ^(U)^v(M) 

m,n>0 i,j,k =1 

<Cx~ 2q N~ 1 22 rn q n q A m+n \\\A N \\\™ +n . 

m,n>0 

The conclusion follows, since A|||Ajv|||i < a < 1 on Ujy. 

Step 5. We next check that \K\ < CxA~ q N~ 1 on Using the bound on (see Step 2), 
we start from 

\K\<C 22 f f \Pm(x,x + A,r)\\/3 n (x,x + A,s)\N~ 1 \\\A N \\\™ +n [(r A Aljdrds 

m,n> CT 0 d ° 

<C{K X + K 2 ), 

where, using that x — A > x/2 (whence (r A s) 1_<? < Cad -9 if r A s > x — A) and a symmetry 
argument, 

rX+A />x+A 


nX-\-/A nX-\-A\ 

K\ =x 1 ~ q 22 / \/3m{x,x + A,r)\\/3 n (x,x + A,s)\N- 1 \\\A N \\\™ +n drds, 

m,n>0 Jx ~ A Jx ~ A 
nX—A pX-\-A 

K 2 =22 / \Pm{x,x +A,r)\\p n (x,x +A,s)\N~ l \\\A N \\\™ +n drds. 

" 0 JO 


m,n> 0 


First, on 


K\ < Ca: 1-9 22 A m+ ”iV _1 |||A/v|||™ +n < CN~ 1 x 1 ~ q < CxA~ q N~ 1 
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since x > A. Next, using that f 0 |/3 m (x, x + A, r)\dr < Cm q A m A q by Lemma 15 (ii) and that 
fo +A \Pn( x , x + A, s)|ds < 2A", still on f+, 

K 2 <CA~ q Y m 9 A TO+ "iV _1 |||j4jv|||™ +n < CA~ q N~ 1 < CxA~ q N~ 1 , 

m,n> 0 

since x > 1 by assumption. 

Step 6. Finally recall that 7 mjT1 (x, x+ A) = f* +A f 0 l+A (sAu)/3 m (x,x+A,s)f3 n (x,x+A,u)duds = 
AAm+n _ Km n \ m + n _|_ £ m n [x, x + A) with the notation of Lemma 15 (hi). We thus may write 

N 


I = PL Y, lm,n{x,X + A)iV“ 2 Y A%(i,j)A n N (k,j)e N (j) = /i- J 2 + / 3) 

m,n> 0 i,j,k= 1 


where 


AT 


E A m+n N~ 2 Y A%(i,j)A n N (k,j)t N (j), 

m,n> 0 i,j,k=l 

N 

h=ll Y Km,nA m+n N~ 2 Y A%(i,j)A n N (k,j)£ N (j), 


m.ri> 0 




AT 


A X! A)AT 2 A%(i,j)A^(k,j)£ N (j). 

i : j,k=l 


m.ri> 0 


First, we clearly have 


AT AT 

h = i^AN- 2 Y QN(i,j)Q N (k,j)t N (j) = plan- 2 YM)) 2 ^nU) = a 

i,j,k =1 i=l 

We next simply set X N = / 2 , which is clearly ....^-measurable and well-defined on 

f+. Finally, since e m ,n{x, x + A) < C(m + n) ? A m+ "iA“ 9 by Lemma 15-(hi), since In is bounded 


on fljy and since, as already seen, Yldj k =1 An (i,j)A n N (k,j)<N\\\A N \\\ 


| m+n 


|/ 3 | < CxA^N- 1 Y { n + m ) q A m+n \\\A N \\\™ +n < CxA~ q N~ 1 . 

m,n>0 

All this implies that |7 —A7V _1 yV’^ 00 + A' Ar | < CxA~ q N~ 1 . Since V+ A = I — J + K by Step 3 and 
since we have seen in Steps 4 and 5 that | J| < Cx~ 2q N- x < CxA~ q N~ l and \K\ < CxA~ q N ~ 1 , 
we conclude that, on f+, — A7V _1 W^ j00 + 1+ < CxA- q N~ 1 as desired. □ 


We can now study the term D A ’j. 

Lemma 29. Assume H(q) for some q > 1. Then a.s. on f+, for 1 < A < t/ 4, < CtA~ 1_9 . 

Proof. We clearly have 


D 


N,4 _ 
A,t 


2 X 
t 


t/A 

Y Var * (^A 


a=t/(2A) + l 


-U2 { a- DA) 


/V ' 

T £ Var, (E7& - t/ ( + 1)A ) - 
a=t/A+l 
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Using Lemma [28} (observe that for a £ {t/(2A) + l,... ,t/A}, x = 2(a—1)A > t satisfies 2A < x/2 
and, for a £ {t/ A + 1 ,..., 2t/A}, x = (a — 1)A > t satisfies A < x/2 ), we get 


D N ’ 4 — 


2 A ^ r2A 


E E W Eo^ JV +M2(a-l)A,2A) 


t ^ LA 

o=t/( 2A) + 1 


2t/A 

T E [^W»,oo-^ + M(a-l)A,A) 

o=t/A+l 


-w. 


N 


This rewrites 


D N ’ 4 — 


2N N 2t / A 

— E r iv(2(a — 1)A, 2A) —— E ^((a - 1)A, A) 


a=i/(2A) + l o=t/A+l 

Since r N {x, A) < CxA~m-\ we find that D*f t < C{N/t)(t/ A^tA-sA" 1 ) = CtA" 1 -?. □ 

N 3 

The following tedious lemma will allow us to treat the last term D A ' t . 

Lemma 30. Assume H(q) for some q > 1. On for all t,x, A > 1 with t/2 < x — A < x +A < 

2 1, 


Var, ((Uf +A - U ?) 2 ) < C( 
and, if t/2 < y — A<y + A<x~ 2A < x + A < 2t, 


A 2 t 2 

+ 


N 2 A 2 A 4 « 


Cov e ((Uf +A - Of) 2 , (Uf +A - E/^) 2 ) < C( 


t 1 / 2 


+ 


t z 


t l/2 


N A®- 1 A 2 A 4 ? jV 2 A^ — / ' 


Proof. We divide the proof in several steps. We work on fl]y. 

5tep L For * = 1,..., N and z £ [x, x + A], we can write, recalling 0 and that /3 n (x,z,r) = 
<p* n (z — r) — ip* n (x — r), 


Ui’ N - ^ = E / &*(*> *> r ) E A n N (i,j)M/’ N dr = V’ N Z + Xi : 

n> 0^° j =1 


,N 

Z 5 


where 


=E [ Pn{x, z,r) E Apf(i,j)(M3’ N - M J x N A )dr, 

n>0 Jx ~ A j =1 

, r z N nx— A N 

X x N Z =J2{J A 7 ’) dr ) E A n(^3) M x-A + J2j 0 X ’ r ) E A N^j) M r Ndr ! 


3=1 

t— 1 ■pi.iV 


n>0 * 

'■iV _ 7\r—1 vi.N 


and we set as usual r^, = A 1 XaIi and = A 1 X*W. 

Step 2. We now show that, on for 2 £ [x, x + A], 

sup E 0 [(Xi x ) 4 } < Ct 2 A~ iq and E e [(X™ z f] < Ct 2 N~ 2 A~ 4q . 
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Using that | f~_ A /3 n (x, z, r)dr\ + A |/3 n (x, z, r)\dr < Cn q A"A q by Lemma 15 (ii) 

N 

\x'£ \<CJ2 n q A n A~ q E A N(i,3) sup \Mi’ N \. 


n> 0 


1 = 1 


[ 0 , 2 *] 


16 


(iii) that sup J=1 _ N Eg[sup[ 0 2 t] \Mi’ N \ 4 ] < Ct 2 . We thus deduce 


But we now from Lemma 
from the Minkowski inequality that, still on 

N 

Efl[(*j£) 4 ] 1/4 < Ct 1/2 A~ q E n q A” E A N(i,j) < Ut 1/2 A~ q E n q A 1 

n> 0 j —1 

We next observe that 

c-A 

Y-W _ 

* — 


< Ct 1/2 A~ q . 


n> 0 


n>0 


( / {3 n (x,z,r)d 

r)o»:\ + Y.[ 

K Jx- A 

n>0^° 


where the martingale 


N 


0?’ n = N~ 1 E A n N (i,j)M{’ N 
*, 1=1 

has for quadratic variation [0 N ’ n ,0 N,n ] r = N~ 2 E.E(EE Av(£, j)) 2 Z}’ N < -/V' _1 |||Ajv|]]i".Z( v 
by Remark 10 By Lemma 16 (iii), we conclude that, on 

EjsuptOf’") 4 ] < CN- 2 \\\A N \\\* n E e l(Z») 2 } < CN- 2 \\\A N \\W n t 2 . 

L [0,2*] J 

Using again that \ f*_ A j3 n (x, z,r)dr\ + / Q x A \f3 n (x, z,r)\dr < Cn q A n A~ q by Lemma 15 (ii), 


sup |o; ¥,r 
[ 0 , 2 *] 


n> 0 


Thus, we infer from the Minkowski inequality that, still on 

E[(AtJ 4 ] 1/4 < Cj2 nqAnA ~ qN ~ 1/2 \\\A N \\\it 1/2 < CA- q N- 1 ' 2 t 1 / 2 . 


n> 0 


Step 3. We next check that Ee[(L^ z ) 4 ] < CA 2 N 2 for any z £ [x, x + A], on . Using the 
same martingale 0 N,n as in Step 2, 

f£, = E / ^ X ’ 

"TJx-a 


n>0 17 x— A 

Recalling that [0 Ar ’",0 A, '"] r = N- 2 EjLiEili Afr(i,j)) 2 Zi< N with EE Av(bj) < 

N 




sup (0?>" - oEa) 4 1 <CiV- 4 |p w ||| 4 "E e [(E(E JV - E’-E)) 

r-A,zl J LV “, ' 


2-i 


1=1 


=CA- 2 |||A JV ||| 4 "E e [(zf - Zf_ A )) 


2-i 


We conclude from Lemma 16 (iii) that (recall that z £ [x,x + A]) 
E@ 


sup (OE-EEa) 4 <UA 2 lV- 2 |p w |||f. 

x— A.zl 
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Using that f A \/3 n (x, z,r)\dr < 2A n and the Minkowski inequality, 

E [(r^ 2 ) 4 ] 1/4 < cJ2A n A 1/2 N- 1/2 \\\A N \w? < CA 1/2 N~ 1/2 . 


n> 0 

Step 4- Recalling Step 1, (U? +A U?)\= (f£ x _ +A + A£ x+a ) 4 < 8(F^ +A ) 4 + 8(A^ +a ) 4 . 

We deduce from Steps 2 and 3 that Var# ((U x+A — U x ) 2 ) < C(A 2 N~ 2 + t 2 N~ 2 A~ iq ). 

Step 5. Here we show that 

Co vo((U? +A -U x N ) 2 ,(U y \ A -U y N f) < Cov e ((f^ +A ) 2 ,(f^ +A ) 2 ) 


t i/ 2 


u / r 

N2\ A 4 ? + A9-3/2 


It suffices to write that (U^ +A - U*) 2 = (r^ +A ) 2 + (X^ x+A ) 2 + 2T* x+A X* x+A , the same 
formula with y instead of x, and to use the bilinearity of the covariance: we have the term 
Cove ((f^ a;+A ) 2 , (r^, y+A ) 2 ), and the other ones are bounded by 


Eg 


& +a ) 2 (^Va) 2 + 2(r^ +A ) 2 |f^ +A x y V A l + (^ +A ) 2 & +A ) 2 

+ i^x,x+A ) 2 (Xy y+A ) 2 + 2(A^ X . +A ) 2 |f^ +A A^ + Al + 2|f^ x+A A^ +A |(f^ +A ) 5 
+ 2|f^ x+A X^ +A |(A^ +A ) 2 + 4|f^ +A A^ +A f^ +A A^ +A | 


Z) J — 


< 


We bound all these terms, using only the Holder inequality and recalling that E[(F X x+ 
CA 2 N~ 2 and E[(A^ X+Z ) 4 ] < Ct 2 N~ 2 A~ 4q and that the same bounds hold with y instead of x. 
We finally remove a few terms using the inequality a+a 3//4 6 1 / 4 +a 1 / 2 6 1 / 2 +a 1 / 4 6 3 / 4 < 4(a+a 1 / 4 6 3 / 4 ) 
with a = t 2 N~ 2 A~ 4q and b = A 2 N~ 2 . 

Step 6. Recall that y + A < x — 2A. We check here that for any r, s G [x — A, x + A], any 
u,v £ [y-A,y + A], any i,j,k,l G {1,..., N}, 

Cov e ((M; >JV - - Mi\), (M* ,N - M* L N A )(M l v ’ N - M^J) \ < Cl^yt 1 ' 2 A 4 ~ q . 

First, i j implies that the covariance vanishes, since Ee[(M* ,iv — M^ A )(M^ ,N — M^ A )\T x -ti\ = 
0 and since u,v < y + A < x— A. We next assume that i = j and w.l.o.g. that r < s. Conditioning 
with respect to T r . we easily find, since u, v < x — A < r, 


K :=Cov e ((My - - M^ A ), (M y - - M‘-" a ) 


i,N 


ly' N 


A,N 

1 y- 


=Cov e (( Mi’ N - M*’5 a ) 2 , (M£ n - My A )(M l v ’ N - M i y A )). 

We write as usual (Mp N — M*’_^) 2 = 2 / X _ A MydMp N + Zp N — ^x~ A i because [M l ' N , M l ’ N ] T = 
Zp N by Remark 10 Since E[/J_ A Af T N dM' T ' N \F x -a\ = 0 and since u, v < x — A, we find that 


K =Cov 8 [.Zy ^ Z^ A , (My M^ A )(M i y M^ A 

=cov e (uy ^ uy A , (My M k y A )(M i y M l y y) 
=cov e (ry Ar +xy Ar , (My - M k y A )(M i y - M i y A )) 


with the notation of Step 1. But F*’ N A involves only increments of martingales of the form 
M4’ N — My 2A , of which the conditional expectation knowing J~ x ~ 2 A vanishes. Since now u,v < 












34 


SYLVAIN DELATTRE AND NICOLAS FOURNIER 


y + A < x — 2 A, we deduce that 

K =Cov e (M*’ N - M*f A )(M l v ’ N - , 

whence 

1*1 < E 0 [(4-a >r ) 2 ) 1/2 n(M*’ N - M^) 4 ] 1 / 4 E[(M l v ’ N - M^’5 a ) 4 ] 1/4 . 

Using Step 2, Lemma [l6|-(iii) and that u — (y — A) < 2A and v — (y — A) < 2A, we easily conclude 
that indeed, \I<\ < CtF 2 A~iA. 

Step 7. We now show, recalling that y + A < x — 2A, that 


Cov e ((f^ +A ) 2 ,(f^ +A ) 2 ) 
We denote by \I\ the left hand side and we start from 

rx-\-A 


< CN~h 1/2 A 1 " 9 . 


t^N 

1 x,x-\-A 


px-\-A N 

= E / Pn(x,x + A ,r)N~ 1 Y A N{i,j){Mr N ~ M x-A) dr i 
n>0 Jx ~ A i,i=1 


whence 


_^ rx +A rx+A ry+A ry+A 

I= Y / / / / /?m(a;,a; + A, r)/3„(x, a; + A, s)/3 Q (y, y + A, u)/? & (y, y + A,u) 

_ _ „ z,\n J x — A J x — A J v— A J V— A 


m,n,a,b> 0 


x—A J x—A Jy—A Jy—A 
N N 

n ~ A Y E A N(iJ)A n N (k,l)A a N (a,S)A b N (7, C) 

i,j,k,l=l a,6,7,C=1 

Cov e ((M^ - mYa)(M 1 s ’ n - M l Y A ), {M 5 u ’ n - M s y ’Y)(M$’ N - M^ A ))dvdudsdr. 

Using that /Ya I Pm(x, x + A, r)|dr < 2A m (and the same formula for the three other integrals), 

Step 6 and that XEi a n(^3) — WA/vllli 1 (and the same formula for the sums in fc, a, 7), we find 
that, still on 

N 

\I\<C Y A m +^ b \\\A N \\\T +n+a+b N^ Y t 1/2 A 1_l3 l {j= j } < CN~ 1 t 1 ^ 2 A 1 ~ q . 

m,n,a,b> 0 j,l,5 £=1 

Step 8. Gathering Steps 5 and 7, we find that 

Cove {(Ux+A - Uf ) 2 , ( U v+ A - Uy ) 2 ) < G(A- 1 t 1 / 2 A 1 - ? + iV 2 f 2 A" 4 « + A" 2 ^/ 2 A 3 / 2 “ 9 ), 


which completes the proof. 

We can finally treat the last term. 

Lemma 31. Assume H(q) for some q> 1. On 12 ]y, for all 1 < A < t/2, 

'A t Nt 1/2 t 2 t 1/2 


□ 


E4(<f) 2 ] < <?(- 


£ A 4 9+! A« +1 AU+ 2 A9+ 1 / 2 /' 

Proof. First note that by definition of D A ’^ and since Uf 1 = Z™ — E e[Zjf], 


E4(<f) 2 ]=^Vare( ]T (U? A - t/£_ 1)A ) 2 ) = ^ £ *«,6, 

a=t/A+l a,6=t/A+l 


2t/A 
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where K a<b = Cov e {{U/ A - U^ a _ 1)A ) 2 , (U/ A - U/ b _ 1)A ) 2 ). If \a - b\ < 2, we only use that 

t 2 


\K a , b \ < (Var e (fe - t/£_ 1)A ) 2 )Var e - t$_i )A ) 2 )) 


1/2 /A 2 


A 2 A 4 ? 


We finally used the first estimate of Lemma|30j which is valid since x = (a — 1) A satisfies x > t and 
thus t /2 <x — A<x + A<2t and x = (b — 1)A satisfies the same conditions. If now \a — b\ > 3 


and w.l.o.g. a > b, we use the second estimate of Lemma 30 which is valid since x = (a — 1) A and 


y = (b — 1)A satisfy the required conditions (in particular, y -f A < x — 2A). This gives 


\KaA < C?( 


We end with 


E*[(<f) 2 ] < C 


+ 


t 2 


N 2 t / A 2 

1?A V/V 2 ' N 2 A 4q 


The conclusion follows. 


t 2 


t i/ 2 


t i /2 

NAi- 1 + N 2 A 4q + a 2 A?- 3 / 2 


N 2 t 2 / t 1/2 t 2 

c l^A^KNAi- 1 + iWA 4 ? 


t i/ 2 

N 2 A q ~ 3 / 2 


□ 


We can at last give the 


Proof of Proposition [£5| Gathering Lemmas [2?i|[2?] [29| and 31 we see that, on ftjy, if 1 < A < i/4, 


-.AM 


E*[|W£ t -Vt£ i00 |] <E e [Dl 


<C(- + 


21 ). 


N,1 
2A ,t 


D 


N, 2 
A ,t 


2D. 


N, 2 
2A,t 


D 


N A 
t 2q 


N 


t q 


-l 


A 9 + 4 


AT,3 
A,t 

t 


2D 


AT, 3 
2A ,i ' 


D 


Nt 1 / 2 


N, 4i 

A,t J 

l 2- 


i 1 / 2 


-V 


A 4 ?+! A 9+1 A 4< ?+ 2 A9+ 1 / 2 / 


Using that q > 3 (whence in particular 2q — 1 > g — 1 > (g + l)/2) and that 1 < A < t, 
we easily deduce that A/t < (A/t) 1 / 2 , that N At~ 2q < 1VA 1-29 < NA ~^ q+1 ^ 2 , that AT 1-9 < 
N A 1 ~ q < JVA-(« +1 )/ 2 , that tA~ q ~ l < tA- q / 2 -/ that U/ 2 A - 29 - 1 / 2 < iA" 29 " 1 < /A -9 / 2-1 , that 
jV 1 / 2 t 1 / 4 A-( |?+1 )/ 2 < AA"( 9+1 V 2 + t 1 / 2 A“( 9+1 )/ 2 < N A-G+L/a + ^A" 9 / 2 " 1 , that /A" 29 " 1 < 
tA~ q / 2 ~ l and that t 4 / 4 A- 9 / 2 - 1 / 4 < tA" 9 / 2 - 1 . This gives, still on ft 


AD 


E e[|W A)t - W^ JOO |] < — + A(q+1)/2 + A9/2 + i) 


as desired. 


□ 


4.7. Conclusion. We now have all the weapons to check our main result. 

Proof of Theorem [3| Recall that we assume H(q) for some q > 3 and that A t = t / { 2 \t 1 ~ i A c i+P ^ 
f 4 /( 9 +i)/2 (for t large). We can of course assume that t > 4 is large enough so that A t £ [1, t/4], 
because else the inequalities of the statement are trivial. Using Propositions [l4| and |~iT| we find 


E 


£?- 


T 


< E 


S? - ^ N 


1 — A p 

Since now Pr((ft] v ) c ) < Ce~ cN by Lemma 
T 


- fiE 


£n — 


1 


1 — A p 


<C( — 
~ \N 


y/Nt 


13 


we conclude that for any e £ (0,1), 


Pr 


cN _ 

* 1-A p 


> 


C/1 1 1 \ „ C ( 1 1 


e) < Ce~ cN + + 

/ “ e V7V y/Nt 


t q ) ~ e \N 


Vrn 
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Similarly, Propositions 


14 


and 


19 


imply, since = p 2 IM*) - 4 r| 2 , 


E 


n p 2 A 2 p(l — p) 


V; - 

* (1 - Ap) 2 


<E 


V N _ V A 
y t oo 


-p 2 e 


i I v' \f a) I i 2 

L «n| 2 ^ \ZnW-Zn\ - n _ A) 2 

i—1 ' “ 


<- 


c 


Wn 


r / r - 1 2 \ 1 / 2 i / TV VN 1 \ 

+ C' E [ 1 Oi,( 1 + X! ) ](^ + ~ + ^) 


4=1 


<- c Q 


A VN 1 

Va 1 ti + t + VV' 


The last inequality uses a second time Proposition [14] We conclude, using Lemma[T3]as previously, 
that for any e £ ( 0 , 1 ), 

p,(vyfto) >A< Ce -« + 5(l + » + ^ + !)<£(! + » + ^?) 

V * ( 1 -Ap ) 2 J e \i/jV ti t Jt) £ VA/V ti t ) 


because t 4 / 2 = (A rl / 4 t 4 / 2 )A 1 / 4 < A 1 / 2 / 1 + A 4 / 2 . This implies that 


Pr 


Vf- 


p 2 A 2 p(l — p) 


*■)*!( 


C/ 1 v/]V \ 


(1 - Ap ) 2 ~ "J ~ £ \^N t >' 

Indeed, either \JN > t and the inequality is trivial or \/N < t and then Nt~ q < Nt~ 2 < A 1 / 2 / -1 . 

since W A j00 = pA -1 Eili v(*)(civ(i)) 2 , that 


Finally, we infer from Propositions 

A* 


14 


and 


25 


E 


Lni 

“a 


X,.* - 


(1 — Ap) 3 


<E 


X,t - W' 


- /iE 


A 


-/v 1 ^ £jv(*)(cAr(»)) 2 - 


1 


(1 — Ap ) 3 


S c(i + l /A + 


IV 


t ■ a ' 9+1)/2 a 


+ 


t 


9/2+1 y ’ 

t 


whence as usual by Lemma 13 for e £ (0,1), 
Pr 


X,- 




At ’ 4 (1 - Ap ) 3 


> e) <Ce~ cN + - ri + \/^ 


/ A t 


A 


£ 


<2A 


e VA 

1 


a (9+ 1)/2 


9/2+1 


A 


e VA ^ 1 - 47 ( 9 + 1 ) t 2 


)■ 


We finally used that A t ~ pV( 9 +i)/ 2 , which implies that y/Afjt ~ i/l/(2f 1 _ 4 /(9 +1 )), that 
A/A ^ +1)/2 ~ 2^ 9 + 1 ^ 2 At -2 and t/A ? /2+1 ~ 2 ‘*/ 2 + 1 H‘ ?+3 )/( g + 1 ) < 29/ 2 + 1 /Vt 1 - 4 /(?+ 1 ). □ 


Proof of Corollary [^} Recall that we assume A(g) for some q > 3. We fix /i > 0, A > 0 and 
p £ (0,1] such that Ap £ (0,1). We define u = p/(l — Ap), e = p 2 A 2 p(l — p)/(l — Ap ) 2 and 
w = pi/(1 — Ap) 3 . It holds that ( u,v,w ) £ H (which would not be the case if Ap = 0) and 
fy(u,v,w) = (p,A,p). Furthermore, T is obviously of class C°° on D, it is in particular locally 
Lipschitz continuous. As a consequence, there is a constant c £ (0,1) (depending on p, A,p) such 


























































STATISTICAL INFERENCE VERSUS MEAN FIELD LIMIT FOR HAWKES PROCESSES 


37 


that for any N > 1, any t > 1, any £ £ (0,1/c), 


Pr 


Vf, W£, t ) - (/i,A,p)|| > e) < Pr (| E? - u\ + \V t N - v\ + - w\>ce ) 


< 


<7/J_ _J_ 

£\N + y/Nt 


i Vn i 

t q + t + y/N 


N 


N t 2 yj £ 1—4 /(<?+!) 


by Theorem[3] Using next that g > 3, that t > 1 and IV > 1, and that either N l / 2 t 1 > 1 (whence 
the inequality below is trivial) or iV 1 / 2 ^” 1 < 1 (whence Nt~ 2 < lV 1//2 f _1 ), we find 


Pr 


1 


(|*(^.Vf,W^ tt )-(/i,A,p)| >e) < - \ 


i //v 

y/N + t ' VU-VU+l) ^' 


Noting that t -(i-4/(q-+i))/2 = [ 7V i/4 t -(i-4/( g +i))/2] 7V -i/4 < JV-1/ 2 + ATi/ 2 t-(i-4/(<?+i)) concludes 
the proof. □ 

We finally give the 


Proof of Remark Lemma 16 -(ii) with r = 1 and s = 0 tells us that on \Eg[Z^]— < C. 

By Lemma [l8l we know that Eg[\Z^ — E@[Z^]|] = Eg[|t/ t JV |] < Cft/N) 1 / 2 , still on and, by 
Propositionn4| E[1 qiJ.£jv — 1/(1 — Ap)|] < (7iV _1 . We easily deduce that 

E[1 q3v 1 2* - Ml - A p)~H\} < (7(1 + (t/N) 1 / 2 + t/N) < (7(1 + t/N). 

Since Pi/fljy) > 1 — Ce~ cN by Lemma 13 we find that for any e > 0, 

<7/1 


Pr I 


Z t N 


M 


t 1 — A p 




The conclusion follows. 


□ 


5. The supercritical case 

The goal of this section is to prove Theorem [6] In Subsection |5.1[ we study precisely the Perron- 
Frobenius eigenvalue and eigenvector of the matrix with nonnegative entries A^fi^j) = N~ 1 9ij. 
In Subsection |5.2[ we state and prove a few results on some series involving < p* n . A few preliminary 
stochastic analysis is handled in Subsection |5.3[ We finally conclude the proof in Subsection |5.4[ 


5.1. Perron-Frobenius analysis of the random matrix An- We recall that the norms 
on and III 


on Mnxn( R) were defined in Subsection 4.1 We denote by (ei,..., ejy) the 


canonical basis of R N and by In = //ZiLi e i the vector will all entries equal to 1. 
Notation 32. We consider the matrix AN(i-,j) = N~ l 0ij and the event 
1 N 

= {n > | and for all i,j = 1,...,N, \N A 2 N (i, j) - p 2 \ < 

1,3 = 1 


P 


2IV 3 / 8 }’ 


Actually, 3/8 could be replaced by any other exponent in [3/8,1/2). We first show that has 
a high probability. 


Lemma 33. Assume that p £ (0,1]. It holds that Pr(fl^) > 1 — Ge cN ! . 
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Proof. We recall the Hoeffding inequality m for a Binomial(n, q )-distributed random variable A': 
for all x > 0, it holds that Pr(|A' — nq\ > x) < 2exp(—2 x 2 /n). 

Since N E^=i A N(i,j) = Efj=i % ~ Binomial(lV 2 ,p), Pr(AT^* Efj=i ^(hj) < P / 2 ) < 
Pr (I^E5=i^iv(*,i) - N 2 p\ > N 2 p/ 2) < 2exp(-7V 2 p 2 /2). 

For each i ± j, we write N 2 A 2 N (i,j ) = Y)k=i QikOkj = Z™ + duOij + OijOjj, where Z™ follows 
a Binomial(7V — 2,p 2 ) distribution. We thus have \N 2 A 2 N (i, j) — Z-j \ < 2. This obviously extends 
to the case where i = j. Hence for any i,j, \NA 2 N (i,j) — p 2 | > p 2 /(2N 3 / 8 ) implies that | Z-j — 
(N — 2)p 2 | > p 2 N 5 ^ 8 /2 — 4 and thus, if N > (16/p 2 ) 8 / 5 , that \Z£j — (N — 2)p 2 \ > p 2 N 5 ^ 8 /4. 
By the Hoeffding inequality, Pt(\N j) — p 2 | > p 2 /(2N 3 ^ 8 )) < 2exp(—p 4 jV 5 / 4 /(8(JV — 2)) < 
2 exp(—p 4 iV 1 / 4 /8). 

All this shows that Pr((fijy) c ) < 2 exp(— N 2 p 2 /2) + 2N 2 exp(—p 4 iV 1 / 4 /8) for all N > (16/p 2 ) 8 / 5 . 
The conclusion easily follows: we can find 0 < c < C depending only on p such that for all N > 1, 
Pr {(n 2 N ) c ) < Ce~ cNl/i . □ 

Next, we apply the Perron-Frobenius theorem. 

Lemma 34. Assume that p £ (0,1]. On £1%, the spectral radius pn of An is a simple eigenvalue 
of A n and p N £ [p( 1 - l/(2A^ 3 / 8 )),p(l + 1/(27V 3 / 8 ))]. There is a unique eigenvector Vn £ (1^+)^ 
of An for the eigenvalue pn such that || Vjv] | 2 = yN. We also have Vjv(i) > 0 for all i = 1,..., N. 

Proof. The matrix An has nonnegative entries and is irreducible on since A 2 N has positive 
entries. We thus infer from the Perron-Frobenius theorem that on pn is a simple eigenvalue 
of An, that there is a unique corresponding eigenvector Vn with nonnegative entries such that 
11 Vzv 11 2 = VN and that Vjv(i) > 0 for all* = 1,..., N. 

Since NA 2 N (i,j) £ [p 2 ( 1 — l/(27V 3 / 8 )),p 2 (l + l/(2iV 3 / 8 ))] for all i,j = 1,..., N on 0? N we de¬ 
duce from p 2 N V N = A 2 N V N that p^||Vjv||i = D? J=1 A 2 N (iJ)V N (j) < p 2 (l + l/(2fV 3 / 8 ))||y A r||i, 
whence p 2 N < p 2 ( 1 + l/(2iV 3 / 8 )) and thus pn < p(l + 1/(27V 3 / 8 )). Similarly, p|/|Viv||i = 
Efj=i^A r{i,j)V N {j) > P 2 ( 1 - 1/(2N 3/8 ))\\V n \\i, whence p 2 N > p 2 ( 1 - 1/(2A^ 3/8 )) and thus 
PN >p(l-l/(21V 3 / 8 )). □ 

We now gather a number of important facts. 

Lemma 35. Assume that p £ (0,1]. There is Nq > 1 (depending only on p) such that for all 
N > Nq, on fijy, the following properties hold true for all i,j,k,l = 1,..., N: 

(i) for all n> 2, A%(i,j) < (3/2 )A%(k,l), 

(ii) V N (i) £ [1/2,2], 

(in) for all n > 0, ||A^ljv[|j| £ [VNp n N /2,2VNp n N \, 

(iv) for all n> 2, A%(i,j) £ [p%/(3N),3p^/N], 

(v) for all n > 0, o«re[l,oo], 111| A n N l N \\- 3 A n N l N - ||V} v ||r 1 Viv| | r < 3(27V- 3 / 8 )L”/ 2 J +1 , 

(vi) for alln> 0, all r £ [l,oo], 111 \A% e^-11 “ 1 ^ e^- - 1111" 1 TV 11 r < 12(2iV 3 / 8 ) L™/2J, 

(mi) for all n > 1, 11 11 2 < 3 p'%/(p'/N) and for all n > 0, ||A]yljv||oo < 3 p^/p. 
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The proof requires a quantitative version of the Perron-Frobenius theorem due to G. Birkhoff 
j7j. It is based on the use of the Hilbert projective distance. 

Notation 36. For x = and y = {yi)i=i,...,N ( 0 , 00 )^, we set 


dN{x,y ) = log y 




mm i= i 

We have djy{x,y ) = djv(y,x) = dw{x,Xy) for all A > 0 and d^{x,y) < djy{x,z) 
Finally, djsi{x,y) = 0 if and only if x and y are colinear. 


dN{z,y). 


The result of Birkhoff quantifies the projection on the Perron-Frobenius vector. 

Theorem 37 (Birkhoff [7], Cavazos-Cadena El)- For any A £ M.nxn{^-) with positive entries 
and any x and y in (0,oo) N , we have d/v(Ar, Ay) < k A dN{x,y), where 


T a = 


max 


A{i, k)A(j, l) 


> 1 and kA = 


VE-i ^ r A -1 
VE + i 


< 


i,j,k,i=i,...,N A(i, l)A(J, k ) 

In our context, this gives the following estimates. 

Remark 38. Assume that p £ (0,1]. Then on dd 2 N , it holds that for all x,y £ {0,oo ) N , we have 

(i) d N {A N x,A N y) < d N {x,y) and (ii) d N (A 2 N x, A 2 N y) < 2N~ 3 / 8 d N {x,y). 

Proof. On f l 2 N , we have 

(11) £ \p 2 N~\ 1 - l/(2N 3 / 8 )),p 2 N~\l + 1/(27V 3 / 8 ))]. 

This implies that for each i = 1,..., N, 1 A/v(*, k) > 0 (because else, A 2 N {i,j) would vanish for 
all j = 1,..., N). Thus for x,y £ (0, 00 )^, we have Apjx, A^y £ (0, oo)^ so that dN{A^x, A^y) is 
well-defined. We put to = mm.i(xi/yi ) and Ad = maXj(xj/t/i). We then have m(Aiyy)i < ( A^x)i < 
M(Aisry)i for all i , whence du^A^x, A^y) < log (M/m) = dN(x,y), which proves (i). For point 

(ii) , it suffices to use Theorem 37 and to note that, by ©> 

•8 N~ 3/s , 


r A'i, = 


max 


i,j,k,i=i,...,N A 2 N {i, l)A 2 N (j, k) 
whence k A ^ < (r^ — l)/4 < 2IV -3 / 8 . 

We will also use the following easy remark. 


A 2 N {z,k)A 2 N {j,l) < (1 + 1/(2iV 3 / 8 )) 2 <± 


(1 — 1/(2 TV 3 / 8 )) 2 


□ 


Lemma 39. For all r £ [1, 00] and all x,y £ (0, oo) N such that d^{x, y) < 1, we have the inequality 
||IMIr ^ - WvWr^ll < 3 d N {x,y). 

Proof. We fix r £ [l,oo] and assume without loss of generality that ||x|| r = ||y|| r = 1. We set 
to = min i(xi/yi) and Ad = maxj(x,/t/,). Since ||x|| r = ||y|| r , it holds that to < 1 < Ad. Using 
that 1 > dN{x,y) = log(l + {Ad — m)/m), we deduce that {Ad — m)/m < e — 1 < 2. Since 
log(l + u) > u/ 3 on [0,2], we conclude that dw{x,y) > {Ad — to)/(3to) > {Ad — to)/ 3. But for 
all i, we have Xi £ [myi , Myf\, whence |xj — yt\ < {Ad — m)yi. Thus ||x — y|| r < {Ad — m)||y|| r = 
{Ad — to) < 3dpj{x, y). □ 


We can now give the 

Proof of Lemma |dd] We work on 0'^, during the whole proof. 

Step 1. We first check that d/v(ljv, Uv) < 27V -3 / 8 . We start from A 2 n Vn = PnVn , so that for all 
i, V N {i) = pfj 2 J2jLi A n(^ j) v N{j)- But using ((TT) and setting k n = p 2 p~ N 2 N~ 1 v nU), we 
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find that Vat (i) £ [kjv(1 — 1/(2-/V 3 / 8 )),kat(1 + 1/(2/V 3 / 8 ))]. Consequently, max.; V/v(i)/min; Vat(?) < 
(1 + l/(21V 3 / 8 ))/(l — 1/(27V 3 / 8 )) < 1 + 21V -3 / 8 . Hence 

d N ( 1 N , V n ) < log[(l + 1/(2iV 3 / 8 ))/(1 - 1/{2N 3 / S ))} < log(l + 2TV" 3 / 8 ) < 2 N~ 3 / 8 . 


Step 2. Here we show that for all i, V) y(i) £ [(1+27V -3 / 8 ) -1 , (1+27V -3 / 8 )]. This will imply point 
(ii) (for N large enough so that 2 N~ 3 ^ 8 < 1). We introduce m = min; Vn(i) and M = max; Vjv(i). 
We have seen in Step 1 that M/m < 1 + 21V -3 / 8 . Recalling that 11 Vjv 11 2 = V^V by definition, 
we deduce that N = ]T^i(Viv(*)) 2 < NM 2 < N(1 + 2_/v -3 / 8 ) 2 m 2 , whence m > (1 + 21V -3 / 8 ) -1 . 
Similarly, N = (M*)) 2 > N m 2 > N(1 + 2lV -3 / 8 ) -2 M 2 , whence M < (1 + 2IV -3 / 8 ). 


5fep 3. We verify that for all n > 0, djv(A-yljv, Vjv) < (2A^ -3 / 8 )L n / 2 J +1 . By Lemma[39| this will 
imply point (v) for all N large enough so that 2IV -3 / 8 < 1. Using that A^Vat = Pat Vat, we deduce 
that . Vn) = djv(Ajy-ljV) AjyVjv). Hence for all n even, we deduce from Remark 38 (ii) 


and Step 1 that obv(^ivljv,Vjv) < (21V 3 / 8 ) n / 2 dAr(ljv, 1/v) < (2IV 3 / 8 ) JI / 2 + 1 . When n is odd, we 


simply use that dN^A/flx, Vn) = d,N(A 7 / f l N , A n Vn) < d^iA^ ljv, Vjv) by Remark 38|(i). 


Step 4- We now prove (vi). We fix r £ [1, 00 ] and j £ {1,..., N}. The result is obvious if n = 0 
or n = 1 because then 11 1 |A^ej \\~ 1 A/ f ej — 11 Vjvl jv | ll^ 1 Wat 11 < 2 < 12(21V -3 / 8 ) L n / 2 J. 


By Remark 

k > 1. 
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(ii), d N (A% ej ,V N ) = d N (A% ej ,A%V N ) < (2N- 3 / s ) k ~ 1 d N (A 2 N e j ,V N ) for all 


We next write dN{A 2 N ej,VN) < d/v(A^e j, l^+d^i^N, Vn)- By Step 1, we have djv(liVj Vat) < 
log[(l + IV -3 / 8 /2)/(l + lV -3 / 8 /2)]. Furthermore, we deduce from that dN{A 2 N ej, Iat) = 
log[max,(H| r (l, j))/min;(A| r (i, j))\ < log[(l + IV -3 / 8 /2)/(1 +lV -3 / 8 /2)]. All in all, we find that 
d N {A 2 Nej ,V N ) < log[(l + IV -3 / 8 /2) 2 /(l - lV -3 / 8 /2) 2 ] < log(l + 8IV -3 / 2 ) < 8N~ 3 / 2 . 

Hence for all k > 1, d^{A 2 ^ej,V^) < 81V -3 / 8 (21V -3 / 8 ) fc-1 = 4(2 N~ 3 / 8 ) k . We also have, by 
(i), d N (A 2k+1 ej,V N ) = d N (A 2k+1 ej,A N V N ) < d N (A 2 ^ej,V N ). Thus for all n > 2, 


Remark 


38 


d/v(^iv e U Vn) < 4(2 N 3 / 8 )L n / 2 J. This implies that indeed, 111 |A^ej| | r 1 A r / f ej — ||Vjv|| r 1 Viv|| < 


12(21V 3 / 8 )L n / 2 J by Lemma [30[ if N is large enough so that 2 N 3 / 8 < 1/4. 

Step 5. We check (i). Using Step 2, we see that for all j = 1,..., IV, all n> 2, 


d N (A^ej,V N ) = log ( 


maxi(-Ajy(z, j)/V N (i)) 
mmi(A^(i,j)/V N (i)) 


'i)>-'< 


(max; A%(i,j) 

min ; A^(i,j) 


x (1 + 27V -3/8 ) -2 ). 
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But for all n > 2, using Remark 
dN(A 2 N ej,VN) < log(l + 8IV -3 / 8 ) as seen in Step 4. We conclude that 


(i), we see that djsr^A^ej, Vn) = dxiA^ej, A 1 /, 2 Vat) < 


max; A%(i, j) 


< (1 + 21V -3/8 ) 2 (l + 8lV -3/s ). 


min; A” (1, j) 

Using the same arguments with the transpose matrix A f N (which satisfies exactly the same as¬ 
sumptions as A at on H^), we see that for alH = 1,..., N, 

ma xj A%(i,j) 


min jA n N (i,j) 
Finally, we conclude that for all n > 2, 


< (1 + 2Af -3/8 ) 2 (l + 8iV -3/8 ). 


max; : j A%(i,j) < 21V -3 / 8 ) 4 (l + 81V -3 / 8 ) 2 . 

mm ;,j A^{i,j) 
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This is indeed smaller than 3/2 if TV is large enough. 

Step 6. We now verify (iii). We write 1 N = \\A’ i ^ 1 n \\ 2 (N~ 1 / 2 Vn + Z N ,n)i where Z N: n = 
~ TV _1 / 2 Vv We know by (v) (with r = 2) that ||^jv,n||2 < 3(2TV -3 / 8 )L n /2j+i. 
We next write, for each n > 0, Af^ 1 l^r = \\A 7 ^ 1 n\\ 2 {N~ 1 ^ 2 p^Vn+A^Zn^). Using that 11 Vjv1 12 = 
a/TV and that 11|^4 ai11 12 < 1 (which immediately follows from the fact that 0 < Ajs/{i,j) < 1/TV), 
we conclude that 11l^vlI 2 - p N \\A^l N \\ 2 \ < 3||A^1jv|| 2 (2TV“ 3 / 8 )L n / 2 J+ 1 . 

We now set x n = ||.Ajyl_/v ||2 / (VNp'f f ). For all n > 0, we have 

\x n+ i - x n | < 3.T„(2TV- 3 / 8 )L"/2j+i /piV < 6a; ri (2TV _3 / 8 )L n / 2 J +1 /p, 

because pn > p/ 2 on tt 2 N , see Lemma [34| If now TV is large enough so that 6(2TV _3 / 8 ) 1 / 2 /p < 1/2, 
we easily conclude, using that Xq = 1, that, for all n > 1, 

n n 

x n £ [ JJC 1 — 6(2TV- 3 / 8 )L fe / 2 J +1 /p), JJ(i + 6(2TV- 3 / 8 )L fc / 2 J +1 /p)j, 

k =1 fc=1 

which is included in [1/2,2] if TV is large enough (depending only on p ). Since Xq = 1, we thus 
have x n e [1/2,2] for all n > 0, and thus | iv| I2 € [VNpn/ 2, 2\fNp^] for all n > 0. 

Step 7. Here we prove (iv). We fix n > 2 and set m = va.va.ij A^(i,j) and M = max^j A^{i,j). 
We know from (i) that M/m < 3/2. Starting from point (iii), we write \fNp r f ] /2 < |I 2 = 
(EiLiQZyLi ^Ar(bi)) 2 ) 1 ^ 2 < N Z / 2 M < 3TV 3 / 2 ?ti/ 2, whence m > p^/(3TV). By the same way, 
2 y/NpN > WA^InIU > TV 3 / 2 m > 2TV 3 / 2 M/3, whence M < 3p^/TV. 

Step 8. It only remains to check (vii). We know from (iv) that for all n > 2, A^(i,j) < Sp^/N < 
3px/{pN). And for n = 1, A N (i,j) < 1/TV < ?>p N /(pN) because pn > p /3 on tl 2 N , see Lemma [34| 
We conclude that for all n > 1, A^(i,j) < 3/9^ /(pN). This immediately implies that for all n > 1, 

\\ A N e j\\2 = (E^li(^ a(*,j)) 2 ) 1/2 < 3 Pn/(p\?N) and ||A^1 jv||oo = max; J2f=i A n(^ j) < 3 p n N /p■ 
Finally, for n = 0, we of course have ||A^1 jv||oo = 1 < 3 p%/p. □ 


Finally, the following tedious result is crucial for our estimation method. 

Proposition 40. We assume that p G (0,1] and we introduce, on Vl 2 N , Vn = TV -1 Euli Vjy(i) an d 


N 

i= 1 


Uv(T)-y ^ 2 

Vn 


There is Nq > 1 and C > 0 (depending only on p) such that for all TV > TVq, 


E 


1 OL 


1 
P 


<-^ and E[lfj 2 .||Viv - Vjvlivlli] < C. 


Proof. We work with TV large enough so that we can apply Lemma [35] We introduce the vectors 
L n = A n 1 n and C N = A%1 N , we set L N = TV" 1 L N (i), C N = TV" 1 C N (i), 

u (Ln(i) — Ln \ 2 ^ n (C n{i) — £n \ 2 

i N ) " d «~=E(— r N —)■ 


We checked in the proof of Proposition [liJ-Step 2 that (i) E[|Ljv — p| 2 ] < CTV 2 , (ii) E[||Ljv — 
L n 1n\\ 4 2} < C, (hi) E[(\\Ln-L n 1n\\ 2 2-p(1~p)) 2 } < CN~\ (iv) E[|| A N L N -L N L N \\ 2 ] < CN~\ 
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We also recall that L N < 1 and 11|^4 jv 111 2 < 1 (simply because 0 < A N {i,j) < 1/N). Further¬ 
more, on tt 2 N , it holds that L N = A -1 l j) > p/2, that C N = A -1 > 

P%/3 > p 6 /192 (by Lemma 35-(iv) and because pn > p/2 by Lemma 341 and that Vy > 1/2 (by 
Lemma 35 (ii)). 

Step 1. We show that on Q 2 N , An = — %n\ < CA -1 / 2 . A simple computation shows that 


Ajv = 


N 

£[( 


Vn(^ 2 
Vn 


(^)1N( E 


Vjyffl £n(0 

Vn 


£ 


N 


( m f X ( 


Vjy(^) | Ajy(z) 
Vn £n 


)) = s n t n , 


the last equality being a definition. 


Lemma 35 (ii) implies that maxj(Vjv(i)/Viv) ^ maxj Vjv(*)/ min^ V)v(*) < 4 and Lemma 35 
(i) implies that maxi(£Ai(*)/£Ar) < max; £Ar(*)/min,; Cn{I) < 3/2 because Cn = A^lyr. Thus 
Tat < 4 + 3/2 < 6. Next, it holds that Sn = N\ | HA^ljvH^A^ljv — ||VArliv||r 1 Viv| j 1 - We thus 
(v) that S N < 3A(2A -3 / 8 ) 4 = 48A" 1 / 2 . The conclusion follows. 


infer from Lemma 


35 


Step 2. We next prove that E[l 0 2 \% N — Hn\] < CN 1 / 2 . We first write 


||£n — (-^Jv) 5 -^7V 1 12 — II^nIn — (^n) 5 ^4n1n||2 < ^ \\(L N ) 5 ,C A I )? 1 1n — {L n ) 6 fc A^ljv||2- 

fc =1 

Using that Lyr < 1 and 11111 12 < 1, we deduce that 

\\£n - (Zn) 5 An||2 < 5||A^1at - L n A n 1 n \\2 = 5||Aat£at — L N L N \\2- 

We thus deduce from point (iv) recalled above that E[||£at — {Ln) 5 l n \\1) < CN- 1 . But it holds 
that ||£jy — (Ln) 5 _An ||2 = In + JAr,_where_/jv = ||(£at - £n1n) — {Ln) 5 {Ln — L n 1n)\\2 and 
J N = ||£at1n - (Zat) 6 1n||2 = VN\Cn - (L n )% Consequently, E[/^] + E[J^] < CN- 1 . Using 
now that 

\\L n — L n 1n\\2 \\{Ln) 5 {Ln — L n 1n)\\2 , ||£at - Zjvlwll! 

tiN = -tv— rv- = - tv— vrv- and Hn = ■ 


{Ln? 


{Ln) 12 


{Ln? 


the facts that Cn > p 6 /192 and {Ln) 6 > p 6 /64 on and that the map 1 4 1 2 is globally 
Lipschitz and bounded on [p 6 /192,oo), we conclude that, still on 


H n — Hn\ <C( ||(LAr) 5 (Ljv - A/v1n)||2|(£/v) 6 - £jv| 


+ 


)■ 


I|£jv — £tv1tvI| o — \\{Ln) 5 {Ln — -Z/jvIjv)115 
Using now the inequality |a 2 — b 2 \ < (a — b) 2 + 2a\a — 6| for a, b > 0, we deduce that 

\Hn ^ Hn\ <c(\\{L n ) 5 {L n - Zn1n)||2-^ _1//2 ^n + In + \\{Ln) 5 {Ln — ZatIaOII^Zv) 
<c(\\L n - LnInW^N- 1 ^' 2 Jn + In + || L N — LnInWIIn^ 

because L N < 1. Using the Cauchy-Schwarz inequality, that E[I^] + E[J^] < CN _1 and that 
E[||£at — Z/atIat1 12 ] < C by point (ii) recalled above, we conclude that E[ 1 q 2 \H n — 7£v|] < CA -1 / 2 . 
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Step 3. Here we check that E[l 0 2 jlLjv — (1/p — 1)|] < CN 1 / 2 . Since L N > p/2 on and 
since x K > x ~ 2 is bounded and globally Lipschitz continuous on [p/ 2,oo), we can write 


H n - - - 


( -0 


\Ln — LnInWI p(1 ~ p) 

n2 


( l nY 


p- 


<C(\L n ~p\p(l -p)+ \\L n - L N l N \\l -p( 1 -p) 


The conclusion follows, since as recalled in points (i) and (iii) above, E[|Ljv — p\\ < CN 1 and 
m\L N -L N l N \\l-p(l-p)\}<CN-V 2 . 

Step 4- Gathering Steps 1, 2 and 3, we immediately deduce that E[1 q^|W^ — (1/p — 1)|] < 
(77V- 1 / 2 . Since now fov < 2 on f l 2 N by Lemma 35 (ii), 11V/v — Vzvliv111 = (Vn) 2 N^ < 4£^, whence 
of course, E[l n ^|| V N - Vjyljvlli] < C. □ 

5.2. Preliminary analytic estimates. We recall the following lemma, relying on some results 
of Feller [T3] on convolution equations, that can be found in [T3J Lemma 26-(b)]. 

Lemma 41. Let : [0,oo) K > [0, oo) be integrable and such that il>(t)dt > 1. Assume also that 
1 1 ^ J 0 |di/;(s)| has at most polynomial growth and set r* = Y /, n >o Consider a > 0 such that 

/ 0 °° e~ at ip(t)dt = 1. There are 0 < c < C such that for all t > 0, 1 + T t £ [ce at , Ce at ]. 

Based on this, it is not hard to verify the following result. 

Lemma 42. Assume A. Recall that a$ was defined in i?e?7iarfc[^ such that p J 0 °° e~ aot ip(t)dt = 1 
and that p jv was defined, for each N > 1, in Lemma 34 We now set = JL>o PnT* 71 ^)- Cor 
any p > 0, we can find N v > 1 and 0 < c v < C v (depending only on p , ip and p) such that for all 
N > Nr,, on n 2 N , for all t > 0, 1 + Tf £ [c^ 00 " 1 ^, 0^°+^}. 

Proof. We only prove the result when p £ (0, ao)> which of course suffices. We consider p+ > 
p > p~ defined by / Q °° e~ < - a ° +ri ' >t (p(t)dt = 1 /p+ and / Q °° e~ ( - a °~ v ^ t ip(t)dt = 1 /p~. We put Tj’ + = 
En>o(/°^) n ^* rl (/) and = Y,n>o(Pv) n ?*”(*)■ Applying Lemma 41 with if = p+ip and with 

if = p“<p, we deduce that there are some constants 0 < c v < C v such that for all t > 0, c I) e(“ 0-rdt < 
1 + T/~ < 1 + Tj’ + < C I) e(“ 0+7? E But on we know from Lemma 34 that pN £ [p( 1 — 
7V _3 / 8 /2),p(l + 7V _3 / 8 /2)]. Thus for N large enough, we clearly have pj<i £ [p^,p+], so that 
Tf £ [ry-,r/’ + ]' The conclusion follows. □ 

We next gather a number of consequences of the above estimate that we will use later. 

Lemma 43. Assume A. Recall that «o was defined in Remark [dj that p jv was defined in Lemma 
34 and that Tf = En>oPjv^*"W- We also P ut v t = d N ~ 1/2 J2 n >o I|A^1at|| 2/ 0 *S(p*"(t - s)ds. 
For any p > 0, we can find N v > 1, t v > 0 and 0 < < C v (depending only on p, p, <p and p) 

such that for all N > N v , on Ll 2 N , 

(i) for all t > 0, vj* < C r) e ( ' ao+r} ' ,t , 

(ii) for all t > t v , v/fi > c v e ( ' ao ~ v ^ t , 

(iii) for all t > 0, E„>o pM 2 A _3/8 )^ /2J / 0 V"(* - s)ds < C 

(iv) for all t> 0, En>o PnSo e^ ao+v ^ s ^ 2 ip* n (t — s)ds < C ?7 e^ a:o+7? ^, 

(v) for all t > 0, J]„>o PNlo sl P* n (t ~ s ) ds < 0^°+^, 
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(vi) for all t > 0, f^f^r^r^e^+^^drds < C t7 e 2 ^+^ t . 

Proof. We fix rj > 0 and work with N large enough and on Qf, so that we can use Lemmas 
and 021 


35 


We start with (i). We know from Lemma 35 (hi) that 11^4^1 iv11 2 < 2 \j r Np 1 f ll whence v f < 
2pf*sT?_ s ds < CnfgSe&o+iW-'lds = C^^+^f'se-^+^ds < 

The LHS of point (iv) is nothing but fge^ ao+r, ^ s ^ 2 r^_ s ds < C' I) / 0 t e^ ao+?7 ^ s / 2 e^ ao+,) ^ t_s ^(is = 
C v e(“°+ , i)* f * e - (<*o + J) s/ 2 < C r ,e ( ~ ao+r i'> t . 

Point (v) follows from point (iv). 

The LHS of point (vi) is smaller than C v f ( ^fge^ ao+ri ^ t ~ r ^e^ ao+r, ^ t ~ s ^e^ ao+r, ^ r/Ks ^drds, which 
equals 2C v f^e^ ao+ri ^ t -^ f Q s e^+^-^e^+^drds = 2C v e^ ao+ ^ t f*se-( ao+r >) a ds < C^ 010 ^ . 

Setting A = J 0 °° ip(t)dt , the LHS of (iii) is bounded by E™>o(^/ ,f ' , ) n P^ r_ ^ 8 ) V n / 2 \ which is itself 
bounded by J2 n>0 {‘2Ap) n {2N~ 3 ^ 8 ) L ri / 2 J since px < 2p on by Lemma 
bounded, as soon as N is large enough so that 2Ap{2N~ 3 / 8 ) 1 / 2 < 1/2. 


34 


This is uniformly 


We finally check (ii). We know from Lemma 35 (iii) that, onfi^, 11^4 jv 1 jv11 2 > '/Np'%/2, whence 
uf > {p/2 ) fySr]v_ s ds > {p/2) J 2 sTffds > (/x/2) J*_ 2 Tf ds if t > 2. By Lemma 42 we thus have 


vf > (/i/2) f t 2 (c^e^ 0 v ^ s — 1 )ds > {p/2 )[c I) e^ Q ° 7) ^ t 2 ) — 1]. The conclusion easily follows: we 
can find t v > 2 and c,, > 0 such that for all t>t v , v f > c rt e ^ OLQ ~ r, ' >t . □ 

5.3. Preliminary stochastic analysis. We now prove a few estimates concerning the processes 
introduced in Notation [9j We recall that no was defined in Remark [5] and that p jv and Vjv were 
defined in Lemma |34[ We start from Lemma 11 to write (with as usual <p*°{t — s)ds = St.{ds )) 


( 12 ) 

(13) 

where 

(14) 

(15) 

(16) 


E e [Zf ] =/iV [ / V n (* - a)dsl A n N l N = v?V N + if, 

n>0 LJ ° J 

Uf = Zf - E fl [Zf] = £ f\* n {t - s)A n N M»ds = Mf + Jf, 

n>0^° 


N 




IIAU 


N 2 


n>0 


vY 


f sip* n {t — s)ds, 
Jo 


IN 


s p* n (. t - s ) di 

n> 0 "'° 


A(v1at — 


HAv 1 


^-*-^112 

Vn 


Vn 


J f = E [ t p* n {t-s)A n N Mfds. 

n>l J ° 


As usual, we denote by and Jf w the coordinates of if and 
empirical mean. We start with some upperbounds concerning Zf and U/ 


and by Jf 

rN 


and Jf their 


Lemma 44. Assume A. For all p > 0, there are N r . > 1 and C v > 0 such that for all N > N.„, 
all t > 0, on 
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(i) max l=1 ,... iJV E e [(Zl’ N ) 2 } < 

(ii) max i=li ... iJV E e[(Ut’ N ) 2 ] < C^N^e 2 ^ 0 ^ + 
(in) E g[(U t N ) 2 ] < C v N~ 1 e 2( ' ao+r, ^ t . 


Proof. We fix rj > 0 and work with N large enough and on 17^, so that we can use Lemmas 35 
andl43l 


Step 1. We first verify that |jEg[Z^]||oo < C' )? e^ ao+ ’ 7 ^. Using ([12]) and that ||A)y-liv||cx> < Cp' 


N 


for all n > 0 by Lemma |35[( vii), we see that HEgfZ^JHoo < C X) ra> o PNlo sl P* n ^ ~ s)ds, whence 
the conclusion by heimria pHl} (v). 

Step 2. We next show that for all i = 1,..., N, E e[{Jf N ) 2 } < C ri N~ 1 e 2 ^° l0+ri ' )t . We start from 
(16), which gives us 

ft ft n 

EoW’ N ) 2 } = E / ^ m {t-r)^ n {t~s)Y. ^{i,j)Al{i,k)MM^ N M^ N ]drds. 

Nn jo jo ., , 

m,n> 1 -i-i 


j,k—l 


But we know from Remark 


10 


that E 6 [M}’ n M*’ n } = l {j=k} E 9 [Z x f s \ < C v l {i=fc} e(“»+^KrA.) 
by Step 1. Furthermore, V=i j) < I|-4-^ei|| 2 1111 2 < CN~ x p^ +n by Lemma 


35 


(vii) (because m,n > 1). We thus find, recalling that I* = X]n>o that 


E el(J l t ’ N ) 2 ] = C ri N 


-1 


r t 7 l r r t 7 l s e (ao+I ' )(rAs) drds. 


0 JO 

The conclusion follows from Lemma [43] (vi). 

Step 3. Point (ii) follows from the facts that Uf N = Mf N + Jf N , that E g[(Mf N ) 2 } = E e[Z l t ' N ] < 
C' I? e(“ 0+I? ) t by Remark 10 and Step 1 and that Eg[( J)’ N ) 2 ] < C rj N~ 1 e 2{ ' ao+v ^ t by Step 2. 

Step 4- Since Z\’ N = E g[Z\' N ] + Uf N , we deduce from Steps 1 and 3 that E{ i[(Zf N ) 2 ] < 
C v (e 2 ^ ao+v ^ t + e( ao+?? ) t + N~ 1 e 2 ^ ao+rl ' >t ) < C'^e 2 ^“ 0+r? ^, whence point (i). 

Step 5. Finally, we write Uf = M+ J™. It is clear from Step 2 that Ee[(j/^) 2 ] < 
CrjN-'e 2 ^ 1 '^. Remark flo| implies that E e[{M t N ) 2 } = N~ 2 Y)Zi E e [Z t i,JV ] < C r] N- x e^ ol0+ ^ t 
by Step 1. Point (iii) is checked. □ 

We next show that the term I) v is very small in the present scales. 

Lemma 45. Assume A. For all rj > 0, there are N v > 1 and C v > 0 such that for all N > N v , 

allt > 0, onQ 2 N , ||lf|| 2 < C v N x / 8 t. 

Proof. We fix rj > 0 and work with N large enough and on so that we can use Lemmas 35 
and 43 Using the Minkowski inequality and then Lemma 35 (iii)-(v), we find 

H^lla </xV T f sip* n (t — s)ds 


An 1 IIAvliv||2 T/ 

A n 1n -7^- VN 


Vn 


n> 0 Jyj 

< 6 /RV [ / ^ n {t - s)ds]N 1 / 2 p n N (2N~ 3 / & )^ n ^ +1 

<12iitN 1 / 8 'ypN(2N- 3/8 )L n/2 l [ v* n (t- s)ds. 

JO 


n> 0 
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The conclusion follows from Lemma |43f (iii). 
We now study the empirical variance of Jp 


□ 


Lemma 46. Assume A. For all rj > 0, there are N v > 1 and C v > 0 such that for all N > N v , 
all t>0, oun 2 N , E e [\\J? - J t N l N \\%] < <7„[e< a ° + ’»>* + AplUv - V^N^e 2 ^ 0 ^]. 

Proof. As usual, we fix r/ > 0 and work with N large enough and on so that we can use 
Lemmas 35 and 43 Starting from ( |16| ) and using the Minkowski inequality, we find 

E e [||jf - J t N l N \\ 2 2 } 1/2 < Y /Vp - s)E 9 [\\A n N M? - Ap4f liv||l] 1/2 ^. 

JO 


n> 1 

But using Remark 10 and then Lemma 44 (i), we see that 

N N 

,1 

i=i - i=i 
N 


o[\\A%M? - AZMflvWl] E 

8=1 i=l j,k= 1 

N N 2 

E (A n N (i,j)--YA n N (k,j)) E e[Zl’ N ] 


i,j =1 


k—1 


N 


<Cp“°+^]T U^ej - A^ejlsWl 

3 =1 

Using next that, for all x,y £ M. N , |||x — xljv|| 2 — \\v ~ 3/1jv|I 2 1 < \\x — y H 2 (with the notation 

x = n~ x J2iLi x i and v = Sili Vt ), we write 

ll^|| 2 , ||A^|| 2| 

Vt- 


\\A^ ej - A% ej l N \\ 2 < 


A n p — 

A N e 3 


Vn 


N 


2 + y/N 


-WVn — Vivljvl I 2 


< 


\\A n N ej || 2 (l2(2Af- 3 / 8 )L"/ 2 J + ll Vjv J^ lN ^ 2 


by Lemma 35-(vi). Since ||A^ej|| 2 < Cp^/y/N by Lemma 35-(vii) (because n > 1), we conclude 
that 

E g [\\A^M^ - Applivlll] 172 <ee (Q0+?7)s/2 p(( r ((2iV-3/8)Ln/2j + \\Vn-VN l N \\ 2 y 
Consequently, 

E e [||jf - Jfliv||i ] 1/2 <C' 7 ) E^(( 2iV ” 3/8 ) L " /2J + -Vn 1 n\\ 2 \ j tp *n( t _ s -) e (ao+r,)./ 2 da 

n> 1 V VN 'Jo 

<Cne (ao+ri)t/2 YPN(2 N ~ 3/8 ) ln/21 [ P* n (t-s)ds 

n> 1 

||V at - Pvliv|| 2 X^pnf e"(i - s)e^ 0+r > )s / 2 ds 
VN Jo 


+ c„ 


<C e < '“ 0+I? - )t / 2 + C 1 12 c (g„+ v )t 

- v v Vn 


by Lemma 43 (iii)-(iv). This completes the proof. 


□ 
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The last lemma of the subsection concerns the martingale Mf. In point (ii) below, (•, •) stands 
for the usual scalar product in R w . 

Lemma 47. Assume A. For all rj > 0, there are N v > 1 and C v > 0 such that for all N > N r) , 
all t > 0, on flfj, 

(i) E e [||Mf - M t N l N \\ 2 } < C v Ne^+ri)t > 

(ii) E 0 [(Mf - M” 1 N ,V N - VnIm) 2 ] < C v \\V N - V N l N \\le^+^ t , 

(in) setting X t N = ||Mf - M t N 1 N \\ 2 - NZ?, we have Eg[\X?\] < C^VNe^+^t. 


Proof. We fix rj > 0 and work with N large enough and on so that we can use Lemmas 35 
and 031 


as usual Remark 


To check point (ii), we write E^M^ — Mf* ljy, Vjy — V/vIat) 2 ] = Ee[(M( v , Vn — VnIn) 2 ] = 
E e[(SiIi(V jv(*) - V N )M l t ' N ) 2 ]. By Remark 10 this equals J2iLi( V N(i) - Vjv) 2 Ee[-£ t I,JV ], which is 
controled by C v \\\ jv — VaiIaiII! 6 ^ 0 " 1 "^* by Lemma 44 (i). 

For point (iii), we first observe that = Y t N — N(Mf r ) 2 , where Y™ = HM^]] 2 — NZ ^. Using 
we deduce that Eg[N(M^) 2 ] = N~ 1 i Eg[Zj ,iV ] < C v e(°‘ 0+r, ^ t by Lemma 


44 


10 


(i). Next, we see that ||Mf|| 2 = Y^=i( M t N ) 2 = 2 EiLi Jo M l- dM l' N + EiLi since 


N 




for each i, [M l ' N , = Zf , see Remark 10 Thus Y t N = 2 JT =1 / 0 M l s _ dM l s ' N . The mar 


0 ‘'‘s- “-“"s 1 4-<i=l ‘-‘t 


tingales f*Ml’ N dMl' N are orthogonal and [J Q M l s ’™ dM l s ' N , f Q M l s ’^ dM l s ’ N ] t = j*(M l s ’^) 2 dZ\' N < 
Z\’ N sup[ 0 t ](M]’ Ar ) 2 . As a conclusion, 


N 


N 


Eg[(Y t N ) 2 ] =4^E e / (Mi'”)*dZi’ N <4^E e (Z\' N f 


-1 1/2 


i =1 


J 0 


i=l 


Efl 


sup {Ml' N f 
L [o.t] 


11/ 2 


Using again that [M l ’ N , M l,N ] t = Z\' N and the Doob inequality, we see that E@[sup[ 0 .t](Mf N ) 4 ] < 
CE e [(Zf N ) 2 ]. This shows that E 0 [(y t JV ) 2 ] < E e [(Z t i ’ Ar ) 2 ] < C v Ne 2 Vo+v)t by Lemma|44[(i). 

Hence E^Y^I] < C r] VNe^ 0+ ^ t and E e [|Xf|] < E^Y^I] + E[N(M t N ) 2 } < C t ,VNe^ ao+r >'> t . 

Finally, (i) follows from (iii), since Eg^M^ — M^1 N \\\] < E^X^I] + NEg[Z^] and since 
NEg[Z^] < Ce^ a ° +r, ' ,t by Lemma 44 (i) again. □ 


5.4. Conclusion. We now conclude the proof of Theorem [6j We recall that 


N 

lY' 

(Zi' N -ZK\ 2 IV] 


rllZf-ZflArlll-TVZfi 

7 — 1 

< z* ) z?\ 

1 {Z t N > 0} 

(zn 2 


U? = 


that V N was introduced in Lemma [34] and that 

N ' V N (i) — V N \ 2 


W> 0}’ 


uZ = 


u- 


i=l 


Vn 


\\V N — WatItv 111 

WnT 2 


We first proceed to a suitable decomposition of the error. 

Remark 48. Assume that p £ (0,1]. We introduce V^ = \U^ — (1/p — 1)| and recall that v^ 
was defined in (14). There is N 0 (depending only on p) such that for all N > N 0 , on the event 

n 2 N n{z?>v?]A>o}, 


V? < \%D t 


+ 128||V)v - V N 1 N \\ 2 2 V?' 2 + |- (1/p - 1)|, 
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where 


v ?’ 1 = 


(tf ) 2 


Zf - Z?l N \\i - NZ? - {v?y\\V N - Vjvlivfl 


and 2?f' 2 = 


N 


Zj_ 

v? 


-Vi 


N 


Proof. We work with N sufficiently large so that we can apply Lemma [35] We obviously have 
X>f < | Wf — Zjf | + |Wf — (1/p — 1)|. We next write, on the event f fl {Zf > uf/4 > 0}, 




N | 


(z t N y 


Zf - Z?1 N \\* - NZ? - (uf f ||Viv - Vjvljv|| 


?JVi 


7 N 


N\2\ 


fV? \ 2 

i 

\zy) 

(Vn) 2 


<16r>f 1 + 128 ||Vjv - V n 1 n \\ 2 2 V 


2't\N,2 


We used that on the present event, ( Z f) 2 < 16(uf) 2 , that Vat > 1/2 (see Lemma 35 (ii)), that 
(Zf/uf) >1/4 and that, for all x,y > 1/4, \x ~ 2 — y _2 | < 128|a; — y\. 


□ 


We now treat the term D: 


,N, 2 


Lemma 49. Assume A. For all r) > 0, there are N v > 1, t ri > 0 and C v > 0 suc/i that, for all 
N > IVij, all t > t v , on , 

/*/ E 0 [X>f’ 2 ] < C rj e 2r,t (N~ 1 ^ 2 + e-“ ot ), 

(m) Pr e (Zf < uf /4) < C 1t e 2r,t (N~ 1 / 2 + e~ a o*). 

Proof. As usual, we fix y > 0 and consider N > N v and t > t v and we work on so that we can 
apply Lemmas [35] and [43] 

Recalling (fl2])-([l3j) , we write Zf = EfZf] + Uf = uf Vjv + if + Uf, whence X>f' 2 < 

that |/f] < TV^lfUa < C^tN 1 / 9 - 1 / 2 , 


45 


(uf) 1 (|/f| + |t/f |). But we infer from Lemma 
which is obviously bounded by C v e vt . Next, we know from Lemma 44 -(iii) that Ee[|E/f |] < 
C rj N~ 1 / 2 e^ ao+ri ' >t . We deduce that Efxf' 2 ] < C ri (v/ , )~ 1 e rit [ 1 + N~ 1 ^ 2 e a ° t }. But since t > t v , we 
know from Lemma 


43 


(ii) that uf > c^e^ 0 v ^. This completes the proof of (i). 

By Lemma 35 (ii), Vjv > 1/2. Thus Zf < uf /4 implies that 2?f’ 2 = | Zf/uf — Vjv| > 1/4. 


Hence Pr e(Z^ < uf/4) < 4Eg[2?f’ 2 ] and (ii) follows from (i). 


□ 


Lemma 50. Assume A. For all p > 0, there are N v > 1, t v > 0 and C v > 0 such that, for all 
N > N v , all t > t v , on £1%, 

E.P,"’ 1 ] < C,( 1 + ||Cv - V»l„||I)e 4 "*(-T + /A + (/J f). 

Proof. We fix rj > 0 and consider N > N v and t > t rj and we work on flf so that we can apply 
and 43 Recalling (12)-(131, we write Zf = uf Vjv + if + Mf + Jf and 


Lemmas 


35 


pf - 1 = 


(uf) 2 


|lf - If 1* + Jf - Jf 1*112 + ||Mf - Mf ljvllf - iVZf 
+ 2(if - Jf ljv + jf - jf 1 N, V?(V N - Vjvljv) + Mf - Mf ljv) 
+ 2uf (Vjv - V N 1 N , Mf - Mf ljv) ■ 
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Recalling that X^ = ||M^ — IjvHj — NZj *, see Lemma 47 we deduce that 
2\\I?-I?l N \\ 2 + 2\\J?-J t N l N \\ 2 + \X> 


V 


N, 1 


< 


1 


- (v?) 2 


H N \ 


+ 2(||If - If 1 N \\ 2 + ||Jf - J?l N \\ 2 )(v?\\V N - Vivljvlla + ||Mf - M?1 N \\ 2 ) 
+ 2v?\(V n - V N 1 N ,M? - M t N 1jv)| 


We know from Lemma 


43 


17 ° a,n<a v t ^ 

I^|| 2 < C' rj A^ 1 / 8 t < C I7 ./V 1 ' /8 e r,t and from Lemma 


45 


(i)-(ii) that v^ > c^e^ 0 ^ and v^ < C r ,e^ a ° + ' n ' >t , from Lemma 

that E e [||jf- 


that ||lf - /fljv||2 < 

Jfljvlll] < C , i)[e^“ 0+I '^ + A r_1 ||lW - Vwlvllle 2 ^ 0 ^ 4 ]. And Lemma 


47 


46 


tells us that Eg[\Xf |] < 


C v VNe^+^, E fl [||M" - 1 a111] < C v Ne^+^ and E e [|(M" - M t N 1 N ,V N - Vivliv)|] < 

CjjIlViv — V N l N \\ 2 e^+v)t/2_ Using the Cauchy-Schwarz inequality, we find 

E^Uf’ 1 ] <Cr;(l + 11 Vjv — Vat liv | Il)e _2 ^“ 0_??)t (^N 1 ^ 4 e 2vt + [ e (“o+r;)t + N -l e 2( ao +v)t} + N l/2 e (ao+v)t 
+ [N 1 ^e nt + e ^“ 0+?7 ^/ 2 + N~ 1 ^ 2 e ( ' ao+v ' >t ] [e^ ao+ ’ 7 ^ t + TV 1 / 2 ^ 00 " 1 " 17 ^/ 2 ] + e 3( ' ao+v ' ,t ^ 2 ' S j. 


We easily deduce that 

EefDf’ 1 ] <C V ( 1 + ||Vat - VjvlArlDe 4 "*(Af" 1/2 + e -“° t/2 + N l / 2 e- aot + Ars/Sg-Sao*^. 

To conclude, it suffices to notice that e _ “ ot / 2 < A 7-1 / 2 + X x l 2 e~ aai and that N 5 ^ 8 e~ 3aot ^ 2 
]\r 3 / 4 e - 3 “ot/2 _ (i\ri/ 2 e _aot ) 3 / 2 . 


< 

□ 


We now have all the weapons to give the 
Proof of Theorem We assume A and fix 77 > 0. 


Step 1. Starting from Remark 48 and using Lemmas 49 and 50 we deduce that there is N v > 1, 
t v > 0 and C v > 0 such that for all N > N v , all t > t r) . 


In? Ee 


L {Z t JV >-uf/4>0} 


-l) 

< 

z£- 

C-- 1 ) 

\P / 



\p / 


+ Cr, l n ^(l + llVzv - VvlA|||)e 4?)t (^ + ^ + (^) ) 


which implies, by Proposition 40 that 


E 


l n%n{z?>v?/4> 0} 


(Hi]<c+*(^+^ + Gsn 




and thus, for all e £ (0,1), 


Pr (+, 2? > +/4 > 0, |+ - (i - l) | > ,) <^(-A + ^ + (^) 3/2 ) 


< 






For the last inequality, we used that either N l / 2 e aot > 1 and then the inequality is trivial or 
Ai 1 / 2 e _ “° t < 1 and then (W 1//2 e _Qo *) 3 / 2 < N x l 2 e~ aot . But we know from Lemma (43)-(ii) that 
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v^ > 0 on f2)y (because t > t v ) and from Lemmas 33 and 49 (ii) that 


Pr((^) c or Z? < v?/A) < Ce~ cNl/i + C v e^ (-L + e"“”*) < C„e 2 * (-!= + , 

whence finally, 


9lL p 4vt( 1 , 


gCKQ t ) ’ 


1 - 1) >£) < —e”'-( _ 

<P ) ) £ \y/N 

We have proved this inequality only for N > N v and t > t v , but it obviously extends, enlarging 

C v is necessary, to any values of N > 1 and t > 0. 

Step 2. We next recall that V™ = where <f>(u) = (1 + u) _1 l{„> 0 } and observe that 

p = $(1 /p— 1). The function <f> is Lipschitz continuous on [0,oo) with Lipschitz constant 1. Thus 
for any e £ ( 0 , 1 ), — p\ > £ implies that either |— ( 1 /p — 1 )| > e or U™ < 0 , so that in any 

case, \U f N — (1/p— 1)| > min{e, (1/p— 1)}. We thus conclude from Step 1 that for any TV > 1, any 

t> 0 , any e £ ( 0 , 1 ), 


Pr{\V?-p\>e)< 
The proof is complete. 
Finally, we handle the 


C„ 


4 Vt ( 1 , < ^.g4r)t ( 1 , 

\JN e“°V “ e \JN e aot /' 


min{e, ( 1 /p- 1 )} V//V 


1 

Vn 


□ 


Proof of Remark [3| We assume A and fix 77 > 0. We know from Lemma 49 4i) that for all N > N v , 
t > trj , Iq^E g[\(Z^/ v^) — V/v|] < C r} e 2r,t {N ^ 1 / 2 + e _ “ 0 *), from Lemma 35 (ii) that Vn £ [ 1 / 2 , 2 ] 
(on f } 2 n ) and from Lemma 33 that Pr(fl^) > 1 — Ce~ cN 1 . We also know from Lemma 43 (i)-(ii) 


that on Qjj, there are 0 < a v < b v such that £ [a^e^ 0 ?? ) t , 6 ^e^“ 0+7? ^]. We easily deduce that, 
still for N > N v and t > t r) , 

Pr (Z? i \{a v /2)e (a °-^ t ,2b v e {aa+ri)t \) < Ce~ cNl/i + C„e 2 , ' t (JV - 1 / 2 + e~ aot ). 

We conclude that for any 77 £ (0, ao/2), lim^oo limjv^-oo Pr(Z^ € [(a ri /2)e ( - ao ~ r, ^ t , 2b v e^ ao+r, ' )t ]) = 
1. This of course implies that for any 77 > 0, lim^oo lim^v-^oo Pr(Z/ v £ [e < '“ 0_?7 ^, e^“ 0+,? ^]) = 1. □ 


6. Detecting subcriticality and supercriticality 


Proof of Proposition [?| We first assume H( 1). We then know from Lemma 16 (i) with r = 1 that, 
on fl]y, E g[Z^] < Ct < e^ ogt ^ 2 /2 for all t large enough, say for all t > t 0 . We also know from 
that, still on fijy, Eg[\Z^ — Eg[Z t JV ]|] = Egflf/^l] < C(t/lV ) 1//2 and from Lemma 


18 


Lemma 

Pr[(fl] v ) c ] < Ce~ cN . We easily deduce that 


13 


that 


Pr(log(Zf) > (logt) 2 ) <Pr((L!] v ) c ) + Pr(L!] v ,E e [Zf] > e^ 2 /2 or \Z?-E 6 [Z?]\> e^ 2 /2) 
<Ce~ cN + C'(t/fV) 1 / 2 e - (lost)2 

for all t > t 0 - Enlarging C if necessary, we conclude that for all t > 1, Pr(log(Z) Y ) > (logt) 2 ) < 
Ce~ cN + Ct 1 / 2 e-( lost ) 2 . 


We next assume A and we fix 77 £ (0, cto). We know from Lemma 49 (ii) that for all N > N r/ 
and t > trj , on f2^, Pr g(Zj* < vf /A) < C v e 2r,t (N~ 1 / 2 + e~ aot ), from Lemma 43 (i)-(ii) that, still 
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on > c v e^ a ° r ^ t > 4e^ Iogt ^ (enlarging the value of t v if necessary), 

tells us that Pr((f2|f) c ) < Ce~ cNl/i . We thus see that 

Pr(log (Z?) < (log*) 2 ) <Pr((fi^) c ) +Pr(n 2 N ,Z t N < vf/4) 
<Ce~ cNl/i + Cr,e 2rit {N- 112 + e~ aot 


Finally, Lemma 


33 


) 


<C v e 2r,t (N~ 1 ^ 2 + e~ aot ). 


All this shows that for all r) £ (0, ao), we can find C^ and try such that for all t > t v and all 
N > N v , Pr(log(Z t JV ) < (logt) 2 ) < C I) e 2,?t (tV _1 / 2 + e~ aot ). We easily conclude that for all rj > 0, 
there is C v such that for all N > 1 and all t > 1, Pr(log(Z f Ar ) < (logt) 2 ) < C r) e 2r,t (N~ 1 ^ 2 + e~ aot ) 
as desired. □ 


7. Numerics 


We say that we are in the independent case when the family is i.i.d. and Bernoulli(p)- 

distributed, as in the whole paper. We say we are in the symmetric case when the family 
{Oij')i<i<j<N is i.i.d. and Bernoulli(p)-distributed and when 9ji = Oij for all 1 < i < j < N. 
We will see that this does not change much the numerical results (with the very same estimators). 
Also, we assume that we observe only {Zl' N ) se \ o,T],i=i,...,if for some (large) K smaller than N. 
The theoretical results of this paper only apply when K = N. We adapt the estimators as follows. 
We introduce Z^’ K = AT -1 ^t’ N an( i 


£?' k = 


f?n,k ?n,k 

z '2t 


V N,K __ « 


u 

i—1 


__ 0 7 N,K v N,K 

vv A.t ~ ,t ^A’ 


where = — 


N 

t 


ryl 

2 1 _ 

t 

2t/A 


N 




N.K 


- -er, 

t 4 ’ 


E ( 


yN,K yN,K _ \c 
^kA ^(fe-l)A 


N.K 


fc=t/A+l 


as well as 


V 


sub,N,K 
A ,T 


= ‘P- 


(cN,K •\;N,K 
\C T /2 > V T/2 i 


w 


N,K 


A,T/2 


N-K 

K 


cN,K 
C T /2 


with $ defined in Corollary [4] We added the absolute value around the last argument of <f> 3 for 
practical reasons: by this way, V S ^^ N,K is always well-defined (and seems closer to the reality 
than 4/ 3 which is 0 when w < 0). This does not change the theory (since VV^’^ 2 — N ~Z K E N ’ K 
asymptoticaly positive, at least when N = K ). We also put 

K yi,N yN,K 

Zj rji Zj r 


K °T/2 


IS 


u^ K = 


r n 

Yk 2. 

i= 1 


V z^ K > 


N 


?N,K 


1 {Z^ K > 0} 


and V■ 


sup,N,K 


U?’ K + 1 


1 {u^ K > 0 }' 


We set Aj = t/(2[t 9 / 13 \), which corresponds to the (quite arbitrary) choice q = 12, and 


~N,K r,sub,N,Ki 

Pt = v a t It 1 


{log(Z™- K )<(logT) 2 } 


sr\SUp,N,K 
• r p -L 


{log(Z”’ Jf )>(logT) 2 }- 


7.1. Choice of the estimators. Let us explain briefly how we have modified the estimators 
when observing only (Z l s ' N ) s ^o,T],i=i,...,K- We adopt the notation of Section [ 2 J in particular 
Ajv(*, j) = N~ 1 9ij , and we follow the considerations therein. 

In the subcritical case, we recall that Qn = (/ — AAjv) -1 and that r(i) = Y^f=iQN{hj)- 
Following closely the argumentation of Subsection |2.1[ we expect that, for t (and A) large and 
in a suitable regime, we should have S^’ K ~ (where = K _1 -^JV(*)), Vt' K — 
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p 2 {N/K) EfLi (4r(*) - ^) 2 , and ~ p{N/K 2 ) E£=i(EiLi Qn(iJ)) 2 ^nU)- Recalling now 

that ^jv(i) — 1 + A(1 — A p)~ 1 L N (i) and that NL n is a vector composed of i.i.d. Binomial(TV,p) 
random variables, we expect that £^’ K — pE[t/v(l)] — /u./(l — Ap) and V^’ K ~ p 2 NYa,r (£jv(1)) ~ 
p 2 A 2 p(l — p)/( 1 — A p) 2 for TV, I\ and t large. For the last estimator, one first has to get convinced, 
following again the arguments of Subsection 


2.1 


■>A 


_ that E»=i QN(i,j ) - 1 + (K/N)Ap/(l - A p) if 

j e {1,..., K} while E^i Qn{iJ) ^ (K/N)(Ap/(l - A p)) if j e {AT + 1,..., TV}. Since we still 
have t\ v(j) ~ 1 + Ap/(1 — A p) = 1/(1 — A p), we find that 


W 


A,A 
A.t — 


pTV 


/v 2 (l - Ap) 

-AT,if 


AT 


1 + 


KAp 


TV(1 - Ap) 


+ (TV - AT) 


KAp 


l-TV(l - Ap) 




(N-K)p 
(1 — Ap) 3 ^ /v(l — Ap) 


Recalling that £" ,n ~ ~ p/(l — Ap), we conclude that — (N — K )£/ 

For TV, AT, t and A large, we thus should have 


AT, A' 


/AT ~ m/( 1 - Ap) 3 




(cN,K , ; A,A 


iV,A AT — AT JV,A 


Wa; - 


A' 


£ 


)=*"( 


p p 2 A 2 p(l — p) p 


1 — Ap’ (1 — Ap) 2 ’ (1 — Ap) 3 


= p. 


We introduce the conjectured limit of as t —> oo: 


A 


N A 


N ~ K pI« 


K 


N 


V suw = L 53(^(i) - ^) 2 , E(E <Mm)) 2 M7) - 

i=l j‘=l i=l 

In the supercritical case, we follow Subsection |2.2| and deduce that for t large, we should have 


Ut’ K ~ (N/K)(V^f) 2 Eil i(Vjv(«) — V//) 2 , where Vjv is the Perron-Frobenius eigenvector of An 
and where V/A = AT -1 Eili Lv(*)- Recalling now that V/v is almost colinear to Ln and that 
NLn is a vector composed of i.i.d. Binomial(7V,p) random variables, we conclude that indeed, 
it should hold that ~ TV(E[Vw(l)]) _2 Var (Vjv( 1)) ~ 1/p — 1 for TV, AT and t large, whence 

psu P: N,K ^ ^ jj ere we introduce the conjectured limit of •p/“A A T K as t oo: 


'jysup 


N.K 


N 


K 


= u 


7.2. Numerical results. From now on, we assume that <p(f) = aexp(-bt) for some a, b > 0, 
which satisfies all our assumptions and is easy to simulate. We also always assume that a = 2 and 
6=1, whence A = 2. We did not find interesting different behaviors when using other values. 

On all the pictures below, we plot the time evolution of the three quartiles, using 1000 sim¬ 
ulations, of p A,A — p, as a function of time t £ [0,T]. We always choose T in such a way that 
Zrp ~ 3000, so that on the right of all the pictures below, we always have more or less the same 
quantity of data (for a given value of K). The curves are not smooth because we use only 1000 
simulations, but this already takes a lot of time. 

For a given simulation, we say that the choice is good when p A,A = anc j Ap < 1 

or p A,A = 'p° up ’ NJ < anc j Ap > 1. When the choice is almost always good (that is, for a large 
proportion of the simulations), we also indicate below the picture the three quartiles of p^ K — p, 
where p^’ A is the conjectured limit as t — > oo of p^’ K , given by p^ K = V when Ap < 1 
and p A,A " = 7^ P,JV,A when Ap > 1. 

We start with the independent case. As the pictures below show, the estimation of p is more 
precise in the fairly supercritical case. Also, around the critical case, p A,A is far from always 
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making the good choice, but this does not, however, produce too bad results. On the contrary, the 
estimation of p when p is very small does not work very well. 

Observe that the results with N = K = 1000 are most often not better than those with 
N = K = 250. This is not so surprising for a given value of T, since our rate of convergence 
resembles T~ 1 N 1 / 2 +7V” 1 / 2 in the subcritical case and something similar in the supercritical case. 

Finally, in all the trials below, it seems that |p A,A — p\ is much smaller than \p^’ K — p\. 

Independent case, p = 0.85, p = 1 (fairly supercritical). The choice is always good for t € [1, 9.7]. 





-0.0073,0.00097,0.0091 


-0.0067,0.0011,0.0080 


-0.0038,0.000086,0.0041 


These pictures illustrate that this situation (fairly supercritical) is quite favorable. 
Independent case, p = 0.65, p = 1 (supercritical). The choice is always bad for t £ [14,19]. 





However, the error (using the wrong estimator) does not seem so large. The jumps correspond to jumps 
of t At. This is particularly visible on these pictures because the time intervall is short. Let us mention 
that the choice becomes good around t = 22. 
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Independent case, p = 0.51, p = 1 (slightly supercritical). The choice is always bad for t £ [9, 62]. 





However, the error (using the wrong estimator) does not seem so large. 

Independent case, p = 0.48, p = 20 (slightly subcritical). The choice is always bad for t £ [1,15] and 
always good for t £ [IT, 20]. 




—0.014, 0.0010, 0.016 


-0.015,0.0017,0.016 


We clearly see the change of choice around t = 16. 



-0.0070,0.00078,0.0076 


Independent case, p = 0.35, p = 1 (fairly subcritical). The choice is always good for t £ (0, 900]. 





-0.012,0.0012,0.014 


-0.012,0.00072,0.015 


-0.0065,0.00021,0.0070 


These results show that the bias is rather large, of the same order as the standard deviation. 
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Independent case, p = 0.1, p = 1 (fairly subcritical). The choice is always good. 





-0.0038, 0.0013, 0.0067 -0.0045, 0.00057, 0.0061 -0.0021,0.00045,0.0032 

These pictures illustrate that this situation (p small) is not quite favorable. 

Independent case, p = 0, p = 1 (subcritical). The choice is always good. 



This is catastrophic. 


In the symmetric case, we obtain very similar numerical results. 

Symmetric case, p = 0.85, p = 1 (fairly supercritical). The choice is always good for t G [1,9.7]. 



- 0 . 0057 , 0 . 0021 , 0.0091 



- 0 . 0062 , 0 . 0012 , 0.0084 



- 0 . 0029 , 0 . 00079 , 0.0044 
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Symmetric case, p = 0.65, p = 1 (supercritical). The choice is always bad for t G [14,19]. 



Symmetric case, p = 0.51, p = 1 (slightly supercritical). The choice is always bad for t G [9,62]. 



Symmetric case, p = 0.48, p = 20 (slightly subcritical but large p). The choice is always bad for t G [1,15] 
and always good for t G [17, 20]. 



- 0 . 014 , 0 . 00095 , 0.018 - 0 . 013 , 0 . 0020 , 0.017 - 0 . 0074 , 0 . 00053 , 0.0078 
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Symmetric case, p = 0.35, p = 1 (fairly subcritical). The choice is always good for t G (0, 900]. 




Finally, we discuss the practical choice of A. 


Independent case, p = 1, p = 0.35 (fairly subcritical), with T = 900 and N — K = 1000. On the left, we 
have plotted V a ^^ N ’ K —p as a function of A G [1,15] obtained with one simulation. On the right, we have 
plotted the quartiles of the same quantity using 1000 simulations. 




Our (arbitrary) choice At = T/(2[T 9 ^ 13 J) ~ 4.1 seems rather suitable: we see on the right picture that 
the “optimal” A lies between 4 and 6. This is mainly due to chance and probably depends strongly on the 
parameters of the model. We see on the left picture that given one set of data, V^^ N ’ K varies a lot. 
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